-- Logs begin at Thu 2022-09-01 15:02:45 UTC, end at Thu 2022-09-01 15:51:31 UTC. -- Sep 01 15:29:07.451007 dv-cinder-852210-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 15:29:07.459796 dv-cinder-852210-8-smb devstack@keystone.service[81779]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 15:29:07 2022] *** Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: nodename: dv-cinder-852210-8-smb Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: machine: x86_64 Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: clock source: unix Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: pcre jit disabled Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: detected number of CPU cores: 4 Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: current working directory: / Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: detected binary path: /usr/bin/uwsgi-core Sep 01 15:29:07.461831 dv-cinder-852210-8-smb devstack@keystone.service[81779]: your processes number limit is 47680 Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: your memory page size is 4096 bytes Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: detected max file descriptor number: 2048 Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: lock engine: pthread robust mutexes Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: thunder lock: enabled Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 15:29:07.462431 dv-cinder-852210-8-smb devstack@keystone.service[81779]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 15:29:07.501777 dv-cinder-852210-8-smb devstack@keystone.service[81779]: Python main interpreter initialized at 0x55af9b14b9c0 Sep 01 15:29:07.501777 dv-cinder-852210-8-smb devstack@keystone.service[81779]: python threads support enabled Sep 01 15:29:07.501777 dv-cinder-852210-8-smb devstack@keystone.service[81779]: your server socket listen backlog is limited to 100 connections Sep 01 15:29:07.501777 dv-cinder-852210-8-smb devstack@keystone.service[81779]: your mercy for graceful operations on workers is 90 seconds Sep 01 15:29:07.502174 dv-cinder-852210-8-smb devstack@keystone.service[81779]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 15:29:07.502857 dv-cinder-852210-8-smb devstack@keystone.service[81779]: *** Operational MODE: preforking *** Sep 01 15:29:07.503056 dv-cinder-852210-8-smb devstack@keystone.service[81779]: *** uWSGI is running in multiple interpreter mode *** Sep 01 15:29:07.503056 dv-cinder-852210-8-smb devstack@keystone.service[81779]: spawned uWSGI master process (pid: 81779) Sep 01 15:29:07.503281 dv-cinder-852210-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 15:29:07.504641 dv-cinder-852210-8-smb devstack@keystone.service[81779]: spawned uWSGI worker 1 (pid: 81790, cores: 1) Sep 01 15:29:07.504884 dv-cinder-852210-8-smb devstack@keystone.service[81779]: spawned uWSGI worker 2 (pid: 81791, cores: 1) Sep 01 15:29:07.506889 dv-cinder-852210-8-smb devstack@keystone.service[81779]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 15:29:11.827449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:29:11.827449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: from cryptography.utils import int_from_bytes Sep 01 15:29:11.828240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:29:11.828240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: from cryptography.utils import int_from_bytes Sep 01 15:29:11.828670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:29:11.828670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: from cryptography.utils import int_from_bytes Sep 01 15:29:11.828778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:29:11.828778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: from cryptography.utils import int_from_bytes Sep 01 15:29:11.877912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 15:29:11.878129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 15:29:11.878294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] command line args: [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 15:29:11.878484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 15:29:11.878569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 15:29:11.878680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 15:29:11.878774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ================================================================================ {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 15:29:11.878878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] command line args: [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 15:29:11.878960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] admin_token = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 15:29:11.879235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] config_dir = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ================================================================================ {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 15:29:11.879392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] config_source = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] admin_token = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] debug = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] config_dir = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.879912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] config_source = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] debug = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.880966 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_config_append = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_dir = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_config_append = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_file = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.881950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_dir = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_file = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882539 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.882978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.883806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.884991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.885929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] publish_errors = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] publish_errors = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.886882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.887968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] standard_threads = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] standard_threads = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888670 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] use_journal = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.888968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] use_json = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] use_journal = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] use_stderr = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] use_json = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] use_syslog = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] use_stderr = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] use_syslog = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.889907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.890044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:29:11.890161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.890993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.891957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.892072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.892187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.892301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.892423 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.893919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.894905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.895914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.896884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.897948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.898935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.899987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.900991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.901948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.902922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.903891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904008 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904488 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.904990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.905880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.906896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.907947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.908062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.908219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.908853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.908983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.909937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.910906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.911978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.912942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.913899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.914915 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.915991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.916819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.external = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.external = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.917909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.password = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] auth.token = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.password = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] auth.token = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.918898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.919981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.920937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.921906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.922897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.923899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.924968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.925983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.926948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.927065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.927181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.927373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.927758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.927889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.928964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.929933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.930927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.931885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.932961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.933979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.934968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.935921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.936925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.937900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.938916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.939987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940340 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.940945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.941899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.942994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.943978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944695 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.944929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945409 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.945888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.946982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.947937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.948886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.949948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.950994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] role.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] role.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] role.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] role.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.951942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.952060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.952189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.952308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.952426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.952544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.959161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.960543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.960694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.960840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.961843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.962981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.963911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.964981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965567 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.965951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.966926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.967982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.968944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.969881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.970652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.971398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.971518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.971652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.971772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.971772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.connection = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972488 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.connection = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.972943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.973869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.974949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.975904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 15:29:11.976993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:29:11.976993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 15:29:11.994447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:11.994678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:11.994765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:11.994902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:11.994987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:11.995203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.003426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.003523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.031554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.031920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.032096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.032267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.086346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.086774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.134867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.135098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.136191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.136428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.292326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.292498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.292690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.292911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.293131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.293346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.293436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.293582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.293820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.294049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.294270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.294487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.316660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.316929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.317892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.318040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.318127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.318286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.328755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.329415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.341678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.341796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.341908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.342890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.343018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.343111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81790) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:29:12.360603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.360815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:29:12.360931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.361141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:29:12.362027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.362136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.362238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:29:12.362323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:29:12.362516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.362599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.362777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.362861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.363036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.363118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.363291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.363372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.372604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.372788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.372873 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.373066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.373150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.373335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.373419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.373615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.380430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.380559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.383338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.383429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.383625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.383709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.383912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.383995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.384841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.385977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.386125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.386270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.408995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.409124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.410478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.410611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.410762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.410900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.415251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.415533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.415618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.415817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.415918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.416103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.422244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.422427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.422512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.422719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.427054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.427346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.427431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.427630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.427715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.427911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.427996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.428187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.428271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.428496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.428775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.429054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.429330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.430174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.430466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.430754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.446171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.446371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.446460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.446651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.450289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.450642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.453350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.453650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.453735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.454042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.458060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.458261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.461165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.461501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.464265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.464560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.464646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.464844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.464928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.465819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.466025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.482268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.482494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.482581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.482787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.482871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.483057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.483144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.483321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.490398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.490790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.492022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.492301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.493552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.493830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.493913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.494154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.496478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.496764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.496901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.497061 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.497193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.497347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.497490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.497638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.497772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.498080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.508857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.509144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.509284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.509428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.509575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.509711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.509864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.510741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.511038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.525857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.526335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.528879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.529215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.531778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.532192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.533749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.534209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.535244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.535528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.535692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.535810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.535979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.536262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.542391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.542663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.543819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.544268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.546685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.546984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.547140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.547270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.547441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.547562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.547727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.548002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.556055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.556343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.556565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.556652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.556863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.557146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.563478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.563765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.563924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81790) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:29:12.564047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.564888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.565929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.566875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.567045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.567126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.567397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.567684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81790) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:29:12.601266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af9b14b9c0 pid: 81791 (default app) Sep 01 15:29:12.601857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af9b14b9c0 pid: 81790 (default app) Sep 01 15:29:12.604997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198293ec-9813-4f76-a2b1-f854381b34d8 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.605287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198293ec-9813-4f76-a2b1-f854381b34d8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.605552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198293ec-9813-4f76-a2b1-f854381b34d8 None None] PATH_INFO: `/v3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.609848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Sep 1 15:29:12 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:19.222135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:19.222684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:19.222684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:19.227681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:19.233332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:19.233808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:19.233945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:19.304560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: INFO dbcounter [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] Registered counter for database keystone Sep 01 15:29:19.323520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG oslo_db.sqlalchemy.engines [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 15:29:19.329768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writer thread running {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 15:29:19.515732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG passlib.handlers.bcrypt [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81791) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 15:29:19.516033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG passlib.handlers.bcrypt [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81791) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 15:29:19.575437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:19.577059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:19.711951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 15:29:20.191910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.260659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: INFO dbcounter [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] Registered counter for database keystone Sep 01 15:29:20.281558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG oslo_db.sqlalchemy.engines [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 15:29:20.287780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writer thread running {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 15:29:20.405735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330682-e707-42ac-8084-f24a9abe2303 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.410106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.410723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.411002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.411274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.420097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.475638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 15:29:20.475913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ae57-fecb-4e25-832d-1950fd487ca3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.486475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 15:29:20.492407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.507420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec36b34-175f-4975-a873-f3599dcb83ab None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.511959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.513054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.513337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.513607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] PATH_INFO: `/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.515239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] RBAC: Authorizing `identity:get_project(project_id=05e98dd4fc624f4b8d51679e7ec2d59b)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.567309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 15:29:20.567662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f548-e94f-4345-94f1-e7114020963e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.572302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:22.486104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8a15-bf66-4898-a333-76e4129199e9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.486725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8a15-bf66-4898-a333-76e4129199e9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.486725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8a15-bf66-4898-a333-76e4129199e9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.490750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:22.496453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.496848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.497011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.517370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:22.518994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:22.527236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 15:29:22.796214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8a15-bf66-4898-a333-76e4129199e9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:22.808209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8a15-bf66-4898-a333-76e4129199e9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:22.812483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:22.813085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.813370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.813647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.821788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:22.823590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e98b1-1e78-4891-a590-b7b2be93f423 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:22.833101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Sep 1 15:29:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:29:22.838760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:22.848108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef4ae7-9c0b-49f1-976e-a247f789a57b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:22.852484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:22.853115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.853400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.853934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.855484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:22.857137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd4bde-caa7-4c03-a256-e6d9e0843b5b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:22.858719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Sep 1 15:29:22 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:24.845522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909580-5075-44cf-a4e6-33a6930b1f33 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.846079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909580-5075-44cf-a4e6-33a6930b1f33 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.846775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909580-5075-44cf-a4e6-33a6930b1f33 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.847956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8408-b4ea-4854-9603-e90c82d56b1e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.848355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:24.848444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8408-b4ea-4854-9603-e90c82d56b1e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.848533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8408-b4ea-4854-9603-e90c82d56b1e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.849825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:24.853300 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.854187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.854471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.855082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.855363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.855641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.874263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:24.875455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:24.898541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG passlib.handlers.bcrypt [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81790) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 15:29:24.898929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG passlib.handlers.bcrypt [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81790) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 15:29:24.948144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:24.949677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:24.956190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 7/12] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:25.049650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 6/13] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:25.222625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.248104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.320629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.329655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5721f73-769f-4872-9bfd-72dc037b09ca None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.364431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.365055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.365368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.365647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.420514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6db810-f8e9-4c6f-9857-a6390ad3a6e1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.422801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.433002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.434679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.458112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.458367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.459978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.460253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.460556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.473624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:25.482373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:25.483280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:25.485703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:25.489271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.538454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:25.544077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.592751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2415a-4525-4816-9918-1861ad891ec6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.627823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.628553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.629051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.629528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.630521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:25.631065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.633256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.646845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 8/16] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:25.649978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d297-aa67-43b9-ae0e-2f2515a26f29 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.652895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.678060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.687295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.690943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.691584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.691866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.692149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.703314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.707103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:25.727495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:25.728360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:25.729451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:25.729451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:25.729451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:25.729451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:25.734618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.761636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05dba4-b81a-4a2a-b9b5-519761345193 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.796351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.796987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.797272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.797546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.799109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.800543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.802371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:25.807692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.837527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966d6c-8c6f-4bd0-bd20-457cb4e0bc13 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.873444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.874102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.874366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.874644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.875294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:25.875598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.877832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.896265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:25.907976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.915663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a5c5-9400-4227-bae2-e6bcdd231265 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.952901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.953860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.953860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.954377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.955768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.957261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08cb3-b75b-424e-8392-c38f74c73068 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.958956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:25.965031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.001794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.081018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ea20e-2300-4d1a-b569-f09787eac56b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.116985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.117624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.117898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.118209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.118949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.domain.id=default, user.id=824d2e5db1534ae296c3e88c19fcec31) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:26.119268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.120723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d893496-cb26-464e-bd21-9f13481e7124 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.128574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 11/21] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/role_assignments?user.id=824d2e5db1534ae296c3e88c19fcec31&scope.domain.id=default&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:28.307362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f835f-6fed-4087-8b56-e14a560d3b49 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.307871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f835f-6fed-4087-8b56-e14a560d3b49 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.307944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f835f-6fed-4087-8b56-e14a560d3b49 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.309408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 11/22] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:28.319392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223e85-fb8a-4def-8728-a3c8b5af9090 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.320269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223e85-fb8a-4def-8728-a3c8b5af9090 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.320773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223e85-fb8a-4def-8728-a3c8b5af9090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.347062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3e223e85-fb8a-4def-8728-a3c8b5af9090 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:28.348611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3e223e85-fb8a-4def-8728-a3c8b5af9090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:28.425268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff31d7-0592-4087-96af-f910c8ac7f27 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.425888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff31d7-0592-4087-96af-f910c8ac7f27 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.426484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff31d7-0592-4087-96af-f910c8ac7f27 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.428251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 12/23] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:28.441725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcf2-ad17-43e5-91dd-5faf40d7ee5a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.442328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcf2-ad17-43e5-91dd-5faf40d7ee5a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.442818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcf2-ad17-43e5-91dd-5faf40d7ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.461954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:28.476109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d7e3dcf2-ad17-43e5-91dd-5faf40d7ee5a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:28.477618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d7e3dcf2-ad17-43e5-91dd-5faf40d7ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:28.558288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f75c2-b265-4571-8e40-953c4454b0a3 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.558888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f75c2-b265-4571-8e40-953c4454b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.559376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f75c2-b265-4571-8e40-953c4454b0a3 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.560925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 13/25] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:28.567199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a798d0-64ed-4281-aeb0-b108708dd59d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.567756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a798d0-64ed-4281-aeb0-b108708dd59d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.568230 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a798d0-64ed-4281-aeb0-b108708dd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.589212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 13/26] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 15:29:28.606227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c3a798d0-64ed-4281-aeb0-b108708dd59d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:28.607696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c3a798d0-64ed-4281-aeb0-b108708dd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:28.645045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:28.707754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:28.723512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049d5e8-d3de-4007-b8f9-35fabbd7fb12 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.724123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049d5e8-d3de-4007-b8f9-35fabbd7fb12 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.724601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049d5e8-d3de-4007-b8f9-35fabbd7fb12 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.726160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 14/28] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:28.731835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.732377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.732856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.754701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:28.756246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:28.847507 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:28.989514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049d5e8-d3de-4007-b8f9-35fabbd7fb12 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.062900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.182407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.195821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.217902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049d5e8-d3de-4007-b8f9-35fabbd7fb12 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.248011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603fd1-5412-4b42-bb54-01edbb18d798 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.290903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.291927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.292428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.292904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.322246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.324879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.326419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.327149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.327645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.327989 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.329569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.331193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf45f5-1924-4911-9ee5-6396bff8e4fb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:29.343512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:29.344458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:29.346126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:29.346126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:29.346126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:29.346126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:29.346855 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.448714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be4ff-0fab-45d9-b1e9-5d236170d3d8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.471042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 16/31] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 15:29:29 2022] POST /identity/v3/roles => generated 219 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:29.472789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b894-d84f-4ae1-a656-88795fd47e30 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.473089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b894-d84f-4ae1-a656-88795fd47e30 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.473374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b894-d84f-4ae1-a656-88795fd47e30 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.478128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 17/32] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:29.478128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b894-d84f-4ae1-a656-88795fd47e30 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.493291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.494071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.494653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.494869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.495678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.497174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.611648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b894-d84f-4ae1-a656-88795fd47e30 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.647886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 16/33] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 15:29:29 2022] POST /identity/v3/roles => generated 225 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:29.648700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.655680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.656961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.658133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.658699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.659263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.660188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:29.660950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.663501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09939cf-0d85-4aba-be76-9108cf6c6c54 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.677662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 18/34] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:29.678855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.679091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.679363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.701151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:29.705153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:29.708832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.800117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e15a22-60b8-4792-a447-f174c4916b5b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.805684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 19/35] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:29.806580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.859301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.860055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.860969 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.861349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.873876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:29.879122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:29.879934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:29.880672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 17/36] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:29.886687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.938795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d99d2-ed1e-4a12-b0ee-0ce031050c32 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.960117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.977614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.978287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.978825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.979103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.979761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.981217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.992319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.007446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2eb72-df94-41a0-9d04-58a2a53ff17d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.015329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 20/37] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:29:29 2022] POST /identity/v3/projects => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:30.050183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.050815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.051093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.051363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.052138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:30.052445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.054076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.064845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 18/38] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:30.070711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.131067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.210804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608e1d-b600-412a-b335-1810418c65f7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.261494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9dcb1-26ab-4b3b-9c1f-b2c81774872a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.289255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.299007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.299640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.299925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.300203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.300907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.302342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53c36e-5096-4543-b817-ff877f50e506 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.317422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 15:29:30 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:29:30.318775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000d84-1dc6-4429-94b2-65c4836f613c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.319067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000d84-1dc6-4429-94b2-65c4836f613c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.319345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000d84-1dc6-4429-94b2-65c4836f613c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.322008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 20/40] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:30.326811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.327428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.327428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.349659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:30.351318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:30.360109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.361349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.361610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.361886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.363866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.365385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.368257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 21/41] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:30.374460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.437366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 21/42] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:30.450627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.501751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751d80-eddd-47bd-a542-6800626aac64 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.536517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.537156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.537439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.537714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.538861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.540306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.542116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:30.547520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.643870 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12365b5-2fc7-4771-bd2f-42ff0510f3dd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.660422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.679191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.679851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.680131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.680404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] PATH_INFO: `/v3/domains/default/users/824d2e5db1534ae296c3e88c19fcec31/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.682322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=824d2e5db1534ae296c3e88c19fcec31, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.683769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.698816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 22/44] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Sep 1 15:29:30 2022] PUT /identity/v3/domains/default/users/824d2e5db1534ae296c3e88c19fcec31/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:30.710059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.825055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb52e-2a6d-4758-9180-2281c855f6db None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.854220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.863774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.864420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.864699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.864973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.866118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.867557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ef9b-3532-428a-926c-26234fc1e13a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.869119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 23/45] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:30.874898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.981508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44221cd-cdb5-4982-a5e6-7c0ab8fc6936 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.014498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.015115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.015403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.015678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.016351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.018730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326db49-061f-47a7-a771-6264338c8261 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.047247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:29:30 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:32.622295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc8775-8bf6-403d-b2c1-982ad2a26c4c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.622815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc8775-8bf6-403d-b2c1-982ad2a26c4c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.622927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc8775-8bf6-403d-b2c1-982ad2a26c4c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.624208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:32.629981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0359c-a26a-401d-88ea-96024f8c65ab None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.630412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0359c-a26a-401d-88ea-96024f8c65ab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.630546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0359c-a26a-401d-88ea-96024f8c65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.648873 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ead0359c-a26a-401d-88ea-96024f8c65ab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:32.650083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ead0359c-a26a-401d-88ea-96024f8c65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:32.675329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.722250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:32.962177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb390b3-8631-4c56-b6cf-ecc65832df04 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.962391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb390b3-8631-4c56-b6cf-ecc65832df04 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.962672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb390b3-8631-4c56-b6cf-ecc65832df04 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.964026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 25/49] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:32.969488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.969781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.970089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.987390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb390b3-8631-4c56-b6cf-ecc65832df04 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.988689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:32.989883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:33.062015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:33.092302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb390b3-8631-4c56-b6cf-ecc65832df04 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.125496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.126753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.127037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.127314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.138239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:33.144537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:33.145481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:33.146436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:33.153039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.238608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.250355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8f06-1532-4a92-96a6-d32d95900dc9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.283288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.283888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.284166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.284438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.285093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:33.285393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.286801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.294540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 26/52] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:33.300636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.335411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.355401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.400366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1084113-8381-4c27-8ab4-b1be7c7c8817 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.436344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.436978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.437258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.437530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.438266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878c7b-0b29-429f-9a4f-3a2ae45a1c0d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.438739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.440183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.441762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:33.447241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.473491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.474166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.474455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.474732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.475852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.477293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.479171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 27/54] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:33.484759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.505266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.546789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fe3c2-8348-41c0-a55b-382067de8a72 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.570756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.583574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.584236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.584517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.584790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.586014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.587489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.589364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:33.595792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.694418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec616c-34f5-42ae-88a0-26984f38dd41 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.703701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41542d6d-b124-4f43-ac0c-5e494f0d0a22 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.730286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.730902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.731190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.731468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.732119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.733560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428209fb-06b5-47e1-9927-1ec006715b1b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.743406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.744019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.744566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.744566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.745297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.domain.id=default, user.id=824d2e5db1534ae296c3e88c19fcec31) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:33.745605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.747067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3eb43-87ec-4600-b79b-1d2aea27f409 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.753385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 29/56] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/role_assignments?user.id=824d2e5db1534ae296c3e88c19fcec31&scope.domain.id=default&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:33.760680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 28/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Sep 1 15:29:33 2022] POST /identity/v3/projects => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:29:35.704413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2052a5-d7ee-46f1-a2ab-574008ea52fe None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.704843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2052a5-d7ee-46f1-a2ab-574008ea52fe None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.704967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2052a5-d7ee-46f1-a2ab-574008ea52fe None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.706334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:35.711456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.711841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.712026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.730355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:35.731568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:35.792487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:35.798566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:36.072259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2052a5-d7ee-46f1-a2ab-574008ea52fe None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:36.128908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:36.174543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2052a5-d7ee-46f1-a2ab-574008ea52fe None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:36.207383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:36.208015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:36.208304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:36.208593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:36.209713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:36.211188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7680949-6e19-4953-bcda-72f5130f456c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:36.212773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:36.218325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:36.314074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5b9a3-1791-4713-98dc-6cac64e2c19c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:36.346715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:36.347255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:36.347538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:36.347816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:36.348476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:36.349902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3a966-5dc4-48fd-a048-7aab2fa7ec18 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:36.375423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:36 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:39.406992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f952-a2f9-40fa-83d1-0fc4eabe855e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.407522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f952-a2f9-40fa-83d1-0fc4eabe855e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.407595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f952-a2f9-40fa-83d1-0fc4eabe855e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.409085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:39.414868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ef20-09f9-4e48-a438-0bff84e50958 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.415306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ef20-09f9-4e48-a438-0bff84e50958 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.415497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ef20-09f9-4e48-a438-0bff84e50958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.443864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5558ef20-09f9-4e48-a438-0bff84e50958 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:39.445904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599296a-4be5-46e2-b32c-f466f2b346e3 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.446288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599296a-4be5-46e2-b32c-f466f2b346e3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.446593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599296a-4be5-46e2-b32c-f466f2b346e3 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.448125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 33/63] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:39.448934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5558ef20-09f9-4e48-a438-0bff84e50958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:39.455479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-cc18-48d2-b12c-42b00c4747c0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.455759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-cc18-48d2-b12c-42b00c4747c0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.456033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de279-cc18-48d2-b12c-42b00c4747c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.482587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4d0de279-cc18-48d2-b12c-42b00c4747c0 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:39.484569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4d0de279-cc18-48d2-b12c-42b00c4747c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:39.571439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.580369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 34/64] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:39.602854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 31/65] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:39.810514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01b5d-a6ac-4761-af7a-4e92b9c17c24 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.811181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01b5d-a6ac-4761-af7a-4e92b9c17c24 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.811724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01b5d-a6ac-4761-af7a-4e92b9c17c24 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.814012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 35/66] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:39.819311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.819600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.819876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.846938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:39.848118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:39.921228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01b5d-a6ac-4761-af7a-4e92b9c17c24 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.940310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 32/67] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:39.996610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.002200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.053645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01b5d-a6ac-4761-af7a-4e92b9c17c24 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.105446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.106824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.107409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.107936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.123735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-fc65c7f5-8042-431c-a6c1-69503a6c1df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.132157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.133205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:40.134163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:40.136158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 36/68] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:40.138216 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db603155-afb9-421e-8c8d-9bb573891ed9 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.138941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db603155-afb9-421e-8c8d-9bb573891ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.139369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db603155-afb9-421e-8c8d-9bb573891ed9 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.142129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 37/69] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:40.143038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db603155-afb9-421e-8c8d-9bb573891ed9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.155561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb7d0-23a0-437f-b213-4165ac48a666 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.175439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.196414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.197379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.197924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.198428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.210325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f8a2d8d8-74f8-4701-9bff-6a7cf4bb41d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.215628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.216463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:40.217190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:40.220342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 33/70] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:40.222279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.222771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.223244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.243196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:40.244790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:40.284766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db603155-afb9-421e-8c8d-9bb573891ed9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.298855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.315578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 34/71] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:40.316432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.320812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.321435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.321728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.322037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.322716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:40.323028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.324418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.337773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 38/72] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.338228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.421352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abc28d-eb69-4f6e-bba6-edfe7eed6aa6 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.429421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.453550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc3b2-a6bd-4ade-82b3-583ac9c3b4f3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.461780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.462429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.462711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.462986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.463664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:40.463964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.465321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb8469-4e4a-40da-b26e-8c8dd33cd290 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.474279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 35/73] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.475719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0ebb-863f-4c7c-9833-8eeaca1a1479 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.476006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0ebb-863f-4c7c-9833-8eeaca1a1479 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.476279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0ebb-863f-4c7c-9833-8eeaca1a1479 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.477675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 36/74] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:40.478190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca0ebb-863f-4c7c-9833-8eeaca1a1479 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.500001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.501183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.501467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.501747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.512331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.517348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.518237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:40.519142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 39/75] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:40.520260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.555930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.589845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca0ebb-863f-4c7c-9833-8eeaca1a1479 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.624240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d736b-b133-4069-9aae-a4570913ec5e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.626281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.626950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.627239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.627522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.629002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.630500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bda235-d99c-43d4-b6e5-f471db150277 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.632089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 37/76] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.636816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.636816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.636816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.651705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:40.652898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:40.658968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.659609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.659891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.660167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.674286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.675832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.677516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 40/77] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.678581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.690354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.732186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 38/78] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:40.732959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.778563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.787625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36cd0-b068-47b2-880f-a12f7c106def None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.824479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.825278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.825591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.825896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.826732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:40.827062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.828543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.838551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 41/79] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.843916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.863724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4b6f-b06f-4680-888d-82bac39c5f2a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.905651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.906720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.907120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.907405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.917920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.922830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.923735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:40.924471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 39/80] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:40.929512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.963597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a68f9-ed8a-4066-be80-c9b9a387123d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.964427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.999809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.000853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.001137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.001416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.027398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.049818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef850c1d-8c96-4dcc-a84e-8f7ea8d044ce None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.077735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.079305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.083666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.084274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.084556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.084831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.160754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.162253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.182662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 42/81] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:41.183646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.191902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.239489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.278843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 40/82] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:41.279616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.285603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131cf2c-2521-4915-9c2e-259fbea46f17 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.318902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.319546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.319840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.320121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.321266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.322739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.324354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 43/83] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.329810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.377203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225be3-edd6-450e-82e1-f66e7a495066 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.402146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.411193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.411799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.412078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.412350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.413008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:41.413312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.414717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.422838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 41/84] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.423723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.430287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041ca4-a219-4440-9dee-bc44ec66d9f8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.453069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.465737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.466401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.466673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.466947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.468077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.470167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.471745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 44/85] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.472502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.525668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e448b9-bd66-4e4c-bb7b-819948fb8a39 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.560453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.561078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.561361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.561631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.563039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.564279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.565929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 42/86] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.566707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.574758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085bd1a-2866-4550-a5ea-55b8a260291f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.609495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.610761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.611042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.611316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.612461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.613938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.615602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 45/87] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.615602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.622638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.667069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88475b0-eb01-4a83-8184-f740863f7049 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.675103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.703582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.704550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.705057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.705547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.726457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f171dc-d82f-4755-9fee-82f114165373 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.761922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.762587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.762882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.763157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.764308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.765887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.767408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 46/88] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.768149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.783472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.784927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.839825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.874159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a37831-c039-4bf9-9c9c-f4ef2fbee490 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.885313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 43/89] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:41.886200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.901390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.910976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.911600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.911888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.912169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.912827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.914324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.940992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 47/90] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:41 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:41.940992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.005737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be23ac-86c4-405f-a575-d5ff008ee904 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.044800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.045433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.046289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.046606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.047557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=824d2e5db1534ae296c3e88c19fcec31) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:42.047911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.049545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.058594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 44/91] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/role_assignments?user.id=824d2e5db1534ae296c3e88c19fcec31&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.059277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.061033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d07623-5b9c-4372-9a43-4c2f3101ac26 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.097686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.107370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.109341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.109341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.109564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.110461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:42.110806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.112452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.119094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 48/92] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.119960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.189246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.225979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23489bb-0334-4741-b0dd-a84df2370bd8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.267539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d984-a9e6-4c77-8449-a6294b8083b3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.282116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.282757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.283042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.283429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.321684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.322392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.322679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.322985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.324226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.326656 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.329793 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 49/93] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.338890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.381729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.383464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.406103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.472945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae54b6e-af2c-4c56-b7dc-3ac76288d692 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.491439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.513473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 45/94] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:42.519830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.524056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.524910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.525369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.525839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.526781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:42.527288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.529052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.536535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 50/95] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.651495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd62a4-3c6f-4f8c-b5bf-cc048e46fa19 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.682777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.701541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.702235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.702517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.702790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] PATH_INFO: `/v3/projects/14bfd3b51dd64469900ada50f62478ff` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.704585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] RBAC: Authorizing `identity:get_project(project_id=14bfd3b51dd64469900ada50f62478ff)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.706061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a692-6608-4a8a-b22f-d69526702503 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.707913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 46/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/projects/14bfd3b51dd64469900ada50f62478ff => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:42.714079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.846470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578ef9-2c32-4f38-965e-30826177bfbc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.889654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.890673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.891685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.892158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.893102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=14bfd3b51dd64469900ada50f62478ff, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:42.893654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.895372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f267e5-c49e-4762-a10e-00af3f704551 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.902282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 51/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=14bfd3b51dd64469900ada50f62478ff&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:44.495194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95dee-ffe6-462d-a5ec-65b701dd934e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.495740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95dee-ffe6-462d-a5ec-65b701dd934e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.495740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95dee-ffe6-462d-a5ec-65b701dd934e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.497097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 47/98] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:44.502932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ea7-1dd8-4828-a009-2fdbdb6476b2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.503319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ea7-1dd8-4828-a009-2fdbdb6476b2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.503500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ea7-1dd8-4828-a009-2fdbdb6476b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.533341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-0f5c5ea7-1dd8-4828-a009-2fdbdb6476b2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:44.534583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0f5c5ea7-1dd8-4828-a009-2fdbdb6476b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:44.578304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.616728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 52/99] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:45.070059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c992f-5e61-436c-93a4-3c6e70431610 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.070421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c992f-5e61-436c-93a4-3c6e70431610 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.070630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c992f-5e61-436c-93a4-3c6e70431610 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.072003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 48/100] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.077440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.077738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.078037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.108389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:45.109313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c992f-5e61-436c-93a4-3c6e70431610 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.118463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:45.255356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 53/101] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:45.277762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c992f-5e61-436c-93a4-3c6e70431610 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.313019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.314025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.314529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.315027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.325818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7995aad5-abb7-415b-b105-4f1e9265a7e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:45.331054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:45.331897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:45.332636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:45.334836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 49/102] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:45.343066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.405434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e12b6-9b6a-4534-b50c-e327577dc130 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.406092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e12b6-9b6a-4534-b50c-e327577dc130 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.407097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e12b6-9b6a-4534-b50c-e327577dc130 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.408670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 50/103] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.414040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002270d7-ca00-4c24-8f85-ce5ef10a408a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.414625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002270d7-ca00-4c24-8f85-ce5ef10a408a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.415118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002270d7-ca00-4c24-8f85-ce5ef10a408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.445494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-002270d7-ca00-4c24-8f85-ce5ef10a408a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:45.448097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-002270d7-ca00-4c24-8f85-ce5ef10a408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:45.542381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.563861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 51/104] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:45.570777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fa12-aeeb-4319-9675-c21300c6d616 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.571475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa179d7-a742-450c-9952-3d863490f48d None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.571778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa179d7-a742-450c-9952-3d863490f48d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.572067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa179d7-a742-450c-9952-3d863490f48d None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.573550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 52/105] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.585056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.587444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee716-073e-4124-b31a-f998ae7d9e1e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.588040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee716-073e-4124-b31a-f998ae7d9e1e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.588040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee716-073e-4124-b31a-f998ae7d9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.607384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cc2ee716-073e-4124-b31a-f998ae7d9e1e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:45.608590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cc2ee716-073e-4124-b31a-f998ae7d9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:45.616729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.617642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.618164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.618662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.619557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:45.620066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.621660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.630480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 54/106] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.631584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.679971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 53/107] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:45.686131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb82d-2d72-4731-941c-a1a9c9ed98a9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.686131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb82d-2d72-4731-941c-a1a9c9ed98a9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.686131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb82d-2d72-4731-941c-a1a9c9ed98a9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.686131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 54/108] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.686131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb82d-2d72-4731-941c-a1a9c9ed98a9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.792065 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9c12-dfde-43a4-ab23-19fd1424266d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.857224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.858393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.859233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.860690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.863247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb82d-2d72-4731-941c-a1a9c9ed98a9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.873814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.874641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-5aae69bf-4067-4d9c-b134-37928d5d8f07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:45.882935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:45.883834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:45.884580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 55/109] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:45.885347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.885778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.886227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.904384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.905029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.905307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.905590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.906792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.907366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:45.908234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfcda1-fdcf-4165-a33d-e802e5887b34 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.908558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:45.909834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 55/110] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.910992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6114-adcd-4885-8827-02f3cf9e7989 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.911281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6114-adcd-4885-8827-02f3cf9e7989 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.911557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6114-adcd-4885-8827-02f3cf9e7989 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.912930 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 56/111] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.913455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd6114-adcd-4885-8827-02f3cf9e7989 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.933140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.994493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 56/112] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:45.995336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.027493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd6114-adcd-4885-8827-02f3cf9e7989 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.063059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.063696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.063988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.064267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.074954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:46.080485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:46.081363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 57/113] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:46.082520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.124529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.127889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad10ef-65dd-490c-a61c-5b311cf232d8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.163584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.164194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.164475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.164748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.165596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:46.165699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.167103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e35ff-1fae-4a4a-b590-8839fdb9c0b0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.175855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 57/114] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.181458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.181744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.182045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.193493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de13f6-92a8-4107-b1cb-b4d0ba268da9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.204632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:46.206703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:46.222166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.230757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.231391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.231673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.231948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.233078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.235100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.237996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 58/115] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.237996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.291675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 58/116] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:46.302154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.337379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b6823-6e4c-4668-83c2-50dfe9868383 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.339745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.375602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.376282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.376566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.376838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.378136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.379477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.385543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 59/117] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.385543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.409679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c24ad-0acb-431c-8e03-16f1ad78ac42 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.450347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.450975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.451239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.451511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.452176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:46.452479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.454432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.462516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 59/118] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.467788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.479850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.496532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6f0c-dcc4-4f89-9c65-53b5e69a10dd None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.532322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.532961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.533246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.533519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.534709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.536142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.537725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 60/119] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.542477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.579779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c92e-eb7a-45bd-a202-b3cc6ac275cc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.583416 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.613584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.614281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.614571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.614852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/824d2e5db1534ae296c3e88c19fcec31/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.616833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, user_id=824d2e5db1534ae296c3e88c19fcec31, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.618343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.632317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 60/120] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:46 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/824d2e5db1534ae296c3e88c19fcec31/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:46.633041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.644029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a5d44-2065-461f-85d8-7ef2b8b65e09 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.692617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.693280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.693563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.693839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.706257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:46.711323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:46.712303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:46.713039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 61/121] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:46.713646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.721746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.763940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84580-5365-4f55-a9fe-b35ba2b70d3c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.805554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.806584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.806876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.807481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.808158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.809627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.827309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.831767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4b75-24a9-44a0-b0d1-2a7438198c7f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.839662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 61/122] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:29:46 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:46.846394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.881401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.882133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.882485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.882713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.883979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.885498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.887525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 62/123] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.888191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.984470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f4b0-e6a8-4db1-8604-721e4100f39e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.007543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.008515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d546-a3be-48ac-8d6f-622404f8a0d2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.026962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.027917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.028203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.028483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.029650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.032540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.034884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 62/124] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.035123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.053274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.054090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.054447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.055252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.068965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:47.074223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:47.075081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:47.075847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 63/125] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:47.076457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.116175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.159777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91b5b-bea2-4b91-afaf-3655b620ee6a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.197613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.198565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.199024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.199516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.200361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:47.200839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.202440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.202901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117c9a-66f0-4106-a626-2d7564d3925f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.212669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 63/126] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.213784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.246087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.246964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.247171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.247588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.249000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.250879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.254001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 64/127] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.254714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.269948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.327366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7891-c040-4023-8ee4-a26d4275fd30 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.372122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.373139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.373648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.374175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.377017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, user_id=0e711eacca6c464aaaf7a9b442a7ce7d, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.378717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.389293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.396618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103b534-eaa8-4398-99a3-206c6c823e24 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.398208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 64/128] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:47 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:47.399459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.436632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.437198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.437516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.438339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.439030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:47.439367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.440896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.450639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 65/129] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.451292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.524229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd132-67fa-47ef-9712-4f385b4ff623 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.537719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.567151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.568257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.568744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.569174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b43e-fd26-4dbb-b49a-c2310af872ec None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.569791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] PATH_INFO: `/v3/users/ca50f6bc45024796a55b50d0cc803323` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.585835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] RBAC: Authorizing `identity:get_user(user_id=ca50f6bc45024796a55b50d0cc803323)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.588367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.590499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 65/130] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/users/ca50f6bc45024796a55b50d0cc803323 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.591694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.607352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.608028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.608322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.608605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.611566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, user_id=0e711eacca6c464aaaf7a9b442a7ce7d, role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.613026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.642160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 66/131] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:47 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:47.643028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.676596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.768961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08507-9615-4468-be29-c71bfdb7ed6d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.810396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a031-dab8-4559-9b45-729656fb6f8a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.832118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.832791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.833088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.834244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.836441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.839469 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.842096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 66/132] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.848599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.893650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.897651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.898329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.898612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.898916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.969950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553be75-3862-4c39-b8f1-2fa1b6977423 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.007830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.008486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.008774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.009051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] PATH_INFO: `/v3/projects/14bfd3b51dd64469900ada50f62478ff` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.010292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] RBAC: Authorizing `identity:get_project(project_id=14bfd3b51dd64469900ada50f62478ff)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.011761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.013426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 67/133] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/projects/14bfd3b51dd64469900ada50f62478ff => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:48.020049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.051165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.052707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.081166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.139961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398af55-ab74-41c7-a121-f1d1c6271e27 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.143245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.183271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.183959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.184248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.184533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] PATH_INFO: `/v3/projects/14bfd3b51dd64469900ada50f62478ff/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.186813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=14bfd3b51dd64469900ada50f62478ff, user_id=0e711eacca6c464aaaf7a9b442a7ce7d, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.188345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.205630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 68/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:48 2022] PUT /identity/v3/projects/14bfd3b51dd64469900ada50f62478ff/users/0e711eacca6c464aaaf7a9b442a7ce7d/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:29:48.249076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 67/135] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:48.255752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.397742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8ca5-1fcb-46d6-abdd-24a341ed0f96 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.433720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.434798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.435287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.435765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.437114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.439324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710dec-9180-41b2-82df-8d0c01b6ded5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.441318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 69/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:48.447478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.580410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff503a-841b-4815-b8e2-c80cf3a865c6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.601666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.621101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.621720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.622032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.622317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.623057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=ca50f6bc45024796a55b50d0cc803323) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:48.623373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.624849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3af786-4367-4263-ada7-665b3a5b0f45 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.630971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 68/137] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/role_assignments?user.id=ca50f6bc45024796a55b50d0cc803323&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=234f99b117064815a664463400930dbc => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.278802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afc6b-3ed2-4ae8-9465-1c5dd167339f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.279835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afc6b-3ed2-4ae8-9465-1c5dd167339f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.280349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afc6b-3ed2-4ae8-9465-1c5dd167339f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.282464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 70/138] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:49.301118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.301404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.301689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.327569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:49.328861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:49.407579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:49.698243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377afc6b-3ed2-4ae8-9465-1c5dd167339f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.737140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.823683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377afc6b-3ed2-4ae8-9465-1c5dd167339f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.873596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.874286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.874566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.874866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.892829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-eaa62cdd-6880-4c8f-b41a-70ca9828c4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:49.897754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:49.898605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:49.899380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:49.903425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 71/140] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:49.907129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.921830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58095-ca57-49e0-aae6-b6cb318fa29b None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.922130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58095-ca57-49e0-aae6-b6cb318fa29b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.922415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58095-ca57-49e0-aae6-b6cb318fa29b None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.923748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 72/141] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:49.928743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.929022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.929296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.967078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:49.968235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:50.064450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 73/142] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 15:29:50.085025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8795ddd-2981-43f5-a661-aea6118a940d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.099817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.133143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.134232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.134719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.135197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.136109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:50.136615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.138228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.151635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 70/143] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:50.158103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.195140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.310263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd145b-34e0-49bd-afed-6ad9861e67c0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.349094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.349742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.350046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.350327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] PATH_INFO: `/v3/users/824d2e5db1534ae296c3e88c19fcec31` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.354635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] RBAC: Authorizing `identity:get_user(user_id=824d2e5db1534ae296c3e88c19fcec31)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.356088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.358080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 74/144] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/users/824d2e5db1534ae296c3e88c19fcec31 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:50.363672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.402814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.572637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0c924-ddd4-463b-8c6b-0f97f80e2230 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.643223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.644203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.644690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.645211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.651812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.673986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e9e0-c6d1-4358-96be-0cedf2da0447 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.712020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.739086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.740615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f3365-8a6a-4a22-8fa6-c0af278b9154 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.752402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.753350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.753823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.754241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.758769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.760333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6162c-641b-4bc1-8437-c8c682e69541 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.762449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 75/145] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:50.766765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8aee-a52c-494f-98f0-0547bc3a4c7c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.767058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8aee-a52c-494f-98f0-0547bc3a4c7c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.767436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8aee-a52c-494f-98f0-0547bc3a4c7c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.769415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 76/146] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:50.770162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8aee-a52c-494f-98f0-0547bc3a4c7c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.857223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 71/147] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:50.858600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f49-bb50-4bc8-8097-9d3ae39c98e6 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.858892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f49-bb50-4bc8-8097-9d3ae39c98e6 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.859675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001f49-bb50-4bc8-8097-9d3ae39c98e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.878935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ea001f49-bb50-4bc8-8097-9d3ae39c98e6 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:50.880050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ea001f49-bb50-4bc8-8097-9d3ae39c98e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:50.923482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8aee-a52c-494f-98f0-0547bc3a4c7c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.952659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 72/148] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:50.960098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5488cc-0660-4de1-98a3-3052c3a1c097 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.960522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5488cc-0660-4de1-98a3-3052c3a1c097 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.960813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5488cc-0660-4de1-98a3-3052c3a1c097 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.962590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 73/149] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:50.966821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5488cc-0660-4de1-98a3-3052c3a1c097 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.974951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.976480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.981120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.981705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.982194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.983135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.987978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3746e8-fa80-4e4d-8981-55c92bdee830 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:51.029176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 77/150] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:50 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:51.030767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe94b-2c99-4547-9fd1-a8663807c002 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.031319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe94b-2c99-4547-9fd1-a8663807c002 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.031781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe94b-2c99-4547-9fd1-a8663807c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.071659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7cdbe94b-2c99-4547-9fd1-a8663807c002 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:51.074372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7cdbe94b-2c99-4547-9fd1-a8663807c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:51.096756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:51.198824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5488cc-0660-4de1-98a3-3052c3a1c097 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.217511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 78/151] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:51.219832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190386-0331-411f-918f-b95e5ceea7b2 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.223699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190386-0331-411f-918f-b95e5ceea7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.225797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190386-0331-411f-918f-b95e5ceea7b2 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.230257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 79/152] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:51.236966 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.237524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.238069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.275984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:51.279862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:51.284134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.285238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.286875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.287395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.288992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:51.293021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:51.296453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 74/153] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:51.298949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.372176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 80/154] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:51.373052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.380068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:51.411421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be451b34-e99f-4e9e-bfaf-d5b4a94bc5ea None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.447659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.448645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.449175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.449639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.461625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:51.461921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:51.467783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:51.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:51.469943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:51.472514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 75/155] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:51.479239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.497998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5db76-e706-41a6-a888-d765f65dc7cc None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.537345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.538232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.539432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.539862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.540904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=824d2e5db1534ae296c3e88c19fcec31) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:51.541382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:51.543004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323361-bc28-48aa-84a8-68c0fbcfaa4c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:51.551208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 81/156] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/role_assignments?user.id=824d2e5db1534ae296c3e88c19fcec31&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:51.552860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea08d4-bde5-489d-b8bd-9624113002e9 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.553293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea08d4-bde5-489d-b8bd-9624113002e9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.553732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea08d4-bde5-489d-b8bd-9624113002e9 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.555282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 82/157] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:51.563746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.564249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.564716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.593054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:51.595200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:51.596643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373020c-2761-4dd8-99db-f04ef63c098b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.632797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:51.645650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.647425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.647732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.648094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.648703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:51.649012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:51.650456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:51.660887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 76/158] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:51.661760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.714962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 83/159] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:51.716664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.823662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fde60-c355-4b4a-a2d8-f1f6bceee64d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.833902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:51.880948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.881608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.881896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.882286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.883548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05508bc6-0702-49cc-8a98-c46dd6d06f5a None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:51.896453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:51.904836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:51.905806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 77/160] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:51.906813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.934334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:51.935433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:51.935914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:51.936356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:51.940291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:51.942533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:51.944305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 84/161] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:51.946807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:51.983442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.044146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a7eb6-748e-4ac3-93a6-c6c7a4e71f26 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.084918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b48-04d5-4407-baa8-f3afa95cca16 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.092155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.092970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.093258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.094120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.110055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:52.116859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:52.117796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:52.118648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 78/162] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:52.119279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.133281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.134289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.134834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.135113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.135807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:52.136115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:52.137562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:52.143363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.156943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 85/163] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:52.158196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.259384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d222e50-8c87-42f4-8588-7b5d25e404d8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.276310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.302121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.302746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893511f-4d09-41c9-87c4-0d0fde03bc35 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.302856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.303032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.303302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.349288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.350314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.350830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.351306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.352908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:52.353745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:52.355920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:52.368744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 86/164] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:52.370276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.387036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:52.388808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:52.477644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.553656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 79/165] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:52.554444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.584176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b305cf-de5f-4445-8a8f-ab85decd89a5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.584849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.651848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.652508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.652794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.653072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.663825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832fe98-11b0-4ca3-9f5c-2c5be1276df3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.671237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:52.677273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:52.678214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:52.678979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 87/166] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:52.684760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.708518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.709155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.709433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.709712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.711223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:52.712650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:52.714266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 80/167] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:52.715029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.877225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:52.891505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d87e-905b-4617-bf5a-1a1b7bba0ee4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.933764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0607ed-639f-41c3-985d-3a8cf6903de1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:52.934099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:52.934749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:52.935034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:52.935310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:52.936702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:52.938716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:52.940351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 81/168] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:52.941119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:52.987643 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.018671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.019418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.019783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.020179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] PATH_INFO: `/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.021431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] RBAC: Authorizing `identity:get_user(user_id=0e711eacca6c464aaaf7a9b442a7ce7d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.022985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.024686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 88/169] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/users/0e711eacca6c464aaaf7a9b442a7ce7d => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:53.025525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.055759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc72e3-e3e1-43a3-a4b7-c53d82fd1375 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.104173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.104794 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.105076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.105349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.106055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:53.106362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.107731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.126310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 82/170] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:53.128170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.154030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.236675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499080-bc44-43ed-8b08-813187cd2be6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.308218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.308853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.309138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.309410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.311836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1159f-fb06-4ecc-ab9a-d84805a4dc94 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.347105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.347717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.348000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.348275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.349007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:53.349315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.350771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.357269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 83/171] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:53.358439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.446434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.458348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.496083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4564-3bb1-4d13-9784-53b4b9404a2b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.497282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.499460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.591779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.592417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.592763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.593041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.720577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 89/172] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:53.721637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.736771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.738267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.842537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.854499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.879779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848676-2c07-45c8-b8c9-d94069a6ca15 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.895159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 84/173] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:53.896350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.959943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.961038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.962065 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.962650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] PATH_INFO: `/v3/users/ca50f6bc45024796a55b50d0cc803323` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.965836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] RBAC: Authorizing `identity:get_user(user_id=ca50f6bc45024796a55b50d0cc803323)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.967488 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.970078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 90/174] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/users/ca50f6bc45024796a55b50d0cc803323 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:53.972102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.103477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12c2a9-cb69-4f92-9fbe-f9087fde49fa None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.172122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.173034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.173475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.173898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.175631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.177233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.179596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 85/175] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.183525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.192875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e62733-15af-433b-8b05-5db3cd94b633 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.255053 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.255619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.255902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.256179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] PATH_INFO: `/v3/projects/14bfd3b51dd64469900ada50f62478ff` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.257579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] RBAC: Authorizing `identity:get_project(project_id=14bfd3b51dd64469900ada50f62478ff)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.259546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.261208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 91/176] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/projects/14bfd3b51dd64469900ada50f62478ff => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.261986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.266710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.318869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.354140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba122af-e0bc-46ee-b65e-6155888a2108 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.401609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.402430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.402713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.402993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.404421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.405869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.406019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ff9e4-e80e-4de2-8bf2-3fdab58aec46 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.412306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 86/177] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.412306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.457877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.458556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.459054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.459332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.460502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:54.460844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.462289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45620e-9ca8-4921-8a89-0120220dddfe None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.469624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 92/178] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.470975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e1cb-6e7d-464b-8ebc-2ccb8124393a None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.471266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e1cb-6e7d-464b-8ebc-2ccb8124393a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.471541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634e1cb-6e7d-464b-8ebc-2ccb8124393a None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.472766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 93/179] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:54.473817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078be8-750d-4719-8148-881de2a45b23 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.474130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078be8-750d-4719-8148-881de2a45b23 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.474408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078be8-750d-4719-8148-881de2a45b23 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.475699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 94/180] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:54.476444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078be8-750d-4719-8148-881de2a45b23 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.524517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c309c13-e3fd-4d8d-b908-69648baa55fb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.542886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.567831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.568467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.568749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.569024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.569769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=14bfd3b51dd64469900ada50f62478ff, user.id=0e711eacca6c464aaaf7a9b442a7ce7d) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:54.570115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.571592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a006-c904-47de-a32a-f13694af9e3d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 87/181] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/role_assignments?user.id=0e711eacca6c464aaaf7a9b442a7ce7d&scope.project.id=14bfd3b51dd64469900ada50f62478ff&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eccf9-5df0-41c9-b6fc-42875263c4a5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eccf9-5df0-41c9-b6fc-42875263c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eccf9-5df0-41c9-b6fc-42875263c4a5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 88/182] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:54.585783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625f42-8abd-4882-9c70-a6766e045aeb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.586359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625f42-8abd-4882-9c70-a6766e045aeb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.586359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625f42-8abd-4882-9c70-a6766e045aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.591244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.606264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b0625f42-8abd-4882-9c70-a6766e045aeb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:54.607612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b0625f42-8abd-4882-9c70-a6766e045aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:54.613355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078be8-750d-4719-8148-881de2a45b23 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.662897 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.663588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.663875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.664156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/ca50f6bc45024796a55b50d0cc803323/roles/234f99b117064815a664463400930dbc` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.668199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, user_id=ca50f6bc45024796a55b50d0cc803323, role_id=234f99b117064815a664463400930dbc)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.669700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012c19-4615-4121-a738-53cc33ff0a21 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.688913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 95/183] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:54 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/users/ca50f6bc45024796a55b50d0cc803323/roles/234f99b117064815a664463400930dbc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:54.690646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.690940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.691220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.720587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:54.722096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:54.727827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 89/184] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:54.730030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.730545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.731045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.754099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:54.755844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:54.808479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 96/185] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:54.838520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 90/186] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:55.050790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.110076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.145025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.150388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.170932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6521f-df79-435b-ae38-e8c2e096a6e6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.213544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.214213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.214495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.214769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.224336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fe81e-5921-43f1-abb0-a41d7d8b1863 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.225406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:55.230737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:55.231664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:55.232489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 97/187] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:55.233256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.271667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.272307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.272587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.272969 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.284264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:55.289647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:55.290768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:29:55.291847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 91/188] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:55.292525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.349449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8f07-c959-4b81-a234-20ddd0de7081 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.386849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.387498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.387852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.388614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.389924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.391507 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.393162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 98/189] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:55.394017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.399287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.406510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a6b3-2549-444f-8c09-5669068d9159 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.407772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.445764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.446717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.446999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.447276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.447952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:55.448255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.449640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.458361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 92/190] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:55.459167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.514890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b377-d9c2-435a-a811-962a82003e5b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.550486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.551104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.551389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.551659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.552338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:55.552647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.554240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.563366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 99/191] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:55.563366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.573105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241ef62-dddc-472d-8c16-a5e7c849d571 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.608534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.609631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.609916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.610304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.610953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.612383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.634682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 93/192] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:55 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:55.635523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.644769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.653130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.702460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e37b-ef25-40c5-b65f-79aa464f3b8f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.759844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.761484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.762512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.762908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.765469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1642d-a5cc-452d-bd8d-e18c2ed02371 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.786941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.789453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.791441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 100/193] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:55.798170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.815286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.815945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.816323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.816602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.818402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.819687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.821447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:55.827182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.944217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d258-6acc-4cd6-81d5-93773388391b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.945421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.969474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6017951-5bba-4475-a0e8-72d2e9f4b822 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.978644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.993504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.994197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.994483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.994759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.014006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:56.014229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.014454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.014689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.082604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.084107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.100823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.103485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.208146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 101/195] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:56.213557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:56.214269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:56.243098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 95/196] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:56.244019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:56.294323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:56.392305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6401-8539-43ae-b3ec-684d1dad611c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:56.412261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bef9-ea9a-4904-9841-ad4c7ad83a5e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:56.452762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:56.453458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.453748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.454075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.455302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.456874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.457583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:56.458522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.459012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.459113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 102/197] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:56 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:56.459576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.464983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:56.465904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.467705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.469810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 96/198] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:56 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:56.475715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:56.574336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:56.622391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:56.630274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c263a-d09c-4202-adbd-9088cd1b86ab None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:56.639208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4a16-9ebc-4525-942a-b27daf43ef31 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:56.691749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061496-51ac-4590-be82-567da8407817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:56.692371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061496-51ac-4590-be82-567da8407817 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.692650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061496-51ac-4590-be82-567da8407817 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.692924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061496-51ac-4590-be82-567da8407817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.693662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061496-51ac-4590-be82-567da8407817 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=6e0187d4761740588512b77a33b32201) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:56.693986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061496-51ac-4590-be82-567da8407817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.695443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061496-51ac-4590-be82-567da8407817 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.701647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 103/199] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:56 2022] GET /identity/v3/role_assignments?user.id=6e0187d4761740588512b77a33b32201&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:56.702690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:56.703413 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.703793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.704161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.705014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=6e0187d4761740588512b77a33b32201) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:56.705432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:56.707097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efede4-d334-4251-99b4-9b49878722b5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:56.714050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 97/200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:56 2022] GET /identity/v3/role_assignments?user.id=6e0187d4761740588512b77a33b32201&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:56.965394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a286a2-f137-435b-9744-cbedc78b1bb6 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.965744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a286a2-f137-435b-9744-cbedc78b1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.965933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a286a2-f137-435b-9744-cbedc78b1bb6 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.967497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 104/201] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:56.973200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.973491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.973764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.996553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:56.997759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:57.081362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 98/202] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:57.450074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a286a2-f137-435b-9744-cbedc78b1bb6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.575809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a286a2-f137-435b-9744-cbedc78b1bb6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.612252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.612898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.613180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.613455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.624063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:57.629542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:57.630459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:57.632523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 105/203] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:57.636565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.685256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:57.741260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f687d-5882-4382-987f-f5e28a460cd8 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.775778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.776414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.776662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.776934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.777603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:57.777904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:57.779285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:57.788612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 99/204] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:57.794197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.819822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:57.945830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053453e2-7ff6-42c5-924e-f48765feb876 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.980748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.981398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.981683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.981971 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] PATH_INFO: `/v3/users/ca50f6bc45024796a55b50d0cc803323` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.983136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] RBAC: Authorizing `identity:get_user(user_id=ca50f6bc45024796a55b50d0cc803323)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:57.984609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b04a10-d990-479e-86e6-47bf5382c515 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:57.986567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 106/205] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/users/ca50f6bc45024796a55b50d0cc803323 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:57.992339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.096599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf88ea-8205-43e7-b949-512cf7c64ebb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.106837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.134734 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.135425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.135781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.136255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.212358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.214339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.281536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7a6d-41e0-497d-b752-e32c26fb0ad4 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.281838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7a6d-41e0-497d-b752-e32c26fb0ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.282036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d7a6d-41e0-497d-b752-e32c26fb0ad4 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.283556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 107/206] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:58.289265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487a29-d25e-4aa6-8848-cb9f3090d862 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.289551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487a29-d25e-4aa6-8848-cb9f3090d862 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.289829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487a29-d25e-4aa6-8848-cb9f3090d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.311221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-fb487a29-d25e-4aa6-8848-cb9f3090d862 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:58.312843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fb487a29-d25e-4aa6-8848-cb9f3090d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:58.341310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 100/207] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:58.348897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.362287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.396282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 108/208] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:58.513231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5a029-4054-4bd0-a9a6-93185451e7c0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.522334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbea2b-cd2a-4e98-bbe4-05faa9245099 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.522637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbea2b-cd2a-4e98-bbe4-05faa9245099 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.522888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbea2b-cd2a-4e98-bbe4-05faa9245099 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.524243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 109/209] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:58.543493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.543752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.543968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.553822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.555987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.556271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.556586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.558612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.560055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.561910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 101/210] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:58.569411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.583268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:58.584476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:58.615407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.665052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.705753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179414-4729-4966-9fd2-65979a069d80 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.746442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 110/211] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:58.761745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.762402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.762681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.762953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.764371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.765006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a, user.id=ca50f6bc45024796a55b50d0cc803323) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.765992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.767571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.781524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 102/212] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/role_assignments?user.id=ca50f6bc45024796a55b50d0cc803323&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=234f99b117064815a664463400930dbc => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.915334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d694b-422a-4e87-a021-607b4a3379ed None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.961191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.961889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.962200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.962473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.963599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.965044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.966964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 111/213] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:58.972808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.081144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360af0b-440d-41c0-96cf-c3f4b8a2c839 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.117832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.118480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.118759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.119034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.119764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.121189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2fcb3-240c-45ae-b24e-6ff5d9d6e32b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.131900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.149918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.152700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 103/214] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:58 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:59.167915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7833e-1a6d-4f4a-a7bf-a35320df38e5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.168476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7833e-1a6d-4f4a-a7bf-a35320df38e5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.168926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7833e-1a6d-4f4a-a7bf-a35320df38e5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.170658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 104/215] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:59.171846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.179798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e8d9-d084-4442-b2e7-eff969713f54 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.180458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e8d9-d084-4442-b2e7-eff969713f54 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.180956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e8d9-d084-4442-b2e7-eff969713f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.210165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-caa6e8d9-d084-4442-b2e7-eff969713f54 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:59.211546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-caa6e8d9-d084-4442-b2e7-eff969713f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:59.299096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 105/216] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:59.300676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0cf8-514c-48b2-9a32-2fff51f966f5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.301167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0cf8-514c-48b2-9a32-2fff51f966f5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.301768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd0cf8-514c-48b2-9a32-2fff51f966f5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.303363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 106/217] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:59.309229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.309790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.310309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.310590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e26956-9d50-4da1-addc-e131a54e514a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.334434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:59.336741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:59.355604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.356250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.356539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.356815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.369410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:59.374698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.375579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:59.376409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 112/218] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:59.381823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.428906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 107/219] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:59.474917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.505257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef45ba-eaaf-4a3b-8cd5-ae4517715602 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.549151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.549774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.550093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.550374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.551054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.551357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.552858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.562110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 113/220] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:59.568042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.571164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.641910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.701544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a98e0-2da6-422e-aef7-690641c0ba5c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.711895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929fdc4-fc65-4cbf-9e8f-2cb986319d51 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.749599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.750392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.750675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.750952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.753163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.753841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.753976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.754158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.754414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] PATH_INFO: `/v3/users/42fe685532e14662a123788552897db1` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.770344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:59.774826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=42fe685532e14662a123788552897db1)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.776457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:59.776637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.777664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:59.778558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 114/221] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:59.779256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.781706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 108/222] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/users/42fe685532e14662a123788552897db1 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.787276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.911035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06c17c-9f6e-47b7-9f4e-97af2faee3a8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.912551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a91c4-2d51-497d-9dd5-00eb86929f76 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.929896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.951495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.953474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.953995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.954518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.956209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.956820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.957104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.957388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.958267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.958581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.960277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.967513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:59.971573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 109/223] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.973001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:59.975328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.976693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:59.977975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:29:59.982309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 115/224] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.983549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.048257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.097360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af963b-441c-42fc-9a85-f1ab6e5d38c5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.100663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948887-7680-4f99-a76a-6466f0e23855 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.131903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.132523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.132806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.133083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.140788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.141732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.142262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.142924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.144293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.146142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.148045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 116/225] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.149031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.178317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.204795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.206074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.266085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb2f26-5ee5-4fd6-acc8-173bdb8a2205 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.292319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.306391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.307284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.307767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.312675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 110/226] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:00.312675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.313344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.314366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:00.314880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.316477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.326484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 117/227] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.327574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.389998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.416166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7398d7-584b-41ea-813f-07ff09a8e1bf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.443409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aab0c-9018-4fbf-8bde-574f6e323c91 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.452158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.452462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.452803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.453082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.454262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.455783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.457611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 111/228] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.458219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.485851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.486905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.487744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.488287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.489697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.491639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.493500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 118/229] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.494574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.558173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.567850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0e74-cb23-41e0-a45d-f6b92af54e82 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.605756 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.606428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.606713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.607001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.608392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.610350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.612307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 112/230] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.612917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.615434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6d4e-4947-49aa-9878-cdbb759b7f17 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.630407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.663980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.664675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.664967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.665242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/6e0187d4761740588512b77a33b32201/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.672526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, user_id=6e0187d4761740588512b77a33b32201, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.672526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.710864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 119/231] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:00 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/6e0187d4761740588512b77a33b32201/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:00.711619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.840311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea697049-7899-4b04-898d-ad826f34fe80 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.947518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.947518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.947899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.948088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.948878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=42fe685532e14662a123788552897db1) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:00.949263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.951052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.975844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 113/232] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/role_assignments?user.id=42fe685532e14662a123788552897db1&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.036818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230f3b2-bf83-4b7e-a478-49f9596f108f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.069745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.118246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.118918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.119198 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.119470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.123835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.126436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9b4f-245b-4caa-9449-9003db1d5b4a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.138521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 120/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.151140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.269387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.296944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eb080-9c88-4495-a217-e81fe3749f34 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.339427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.340109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.342130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.342130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/6e0187d4761740588512b77a33b32201/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.348020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, user_id=6e0187d4761740588512b77a33b32201, role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.351280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdc57f-7897-4ea7-8e5d-9643b5fccdf0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.378254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 114/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:01 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/6e0187d4761740588512b77a33b32201/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:01.773843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94be05-0d12-4391-93c1-953e811a45f2 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.774212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94be05-0d12-4391-93c1-953e811a45f2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.774423 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94be05-0d12-4391-93c1-953e811a45f2 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.775769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 121/235] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:01.781266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2930-b4d2-4b75-9448-71201fdac7de None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.781554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2930-b4d2-4b75-9448-71201fdac7de None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.781836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2930-b4d2-4b75-9448-71201fdac7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.806948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e71a2930-b4d2-4b75-9448-71201fdac7de None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:01.808149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e71a2930-b4d2-4b75-9448-71201fdac7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:01.893685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 115/236] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:01.939689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f2fb-b465-4a6a-a7aa-7ebf0a86c034 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.939969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f2fb-b465-4a6a-a7aa-7ebf0a86c034 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.940167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f2fb-b465-4a6a-a7aa-7ebf0a86c034 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.941702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 122/237] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:01.950045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.950045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.950045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.967525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:01.969085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:02.031337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.042382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 116/238] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:02.188855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f2fb-b465-4a6a-a7aa-7ebf0a86c034 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.301511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f2fb-b465-4a6a-a7aa-7ebf0a86c034 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.336890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.337887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.338415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.338924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.350250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:02.356043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:02.356932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:02.357723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:02.360134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 123/239] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:02.366127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.380334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.463937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.500697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49876c5-0863-4c56-a835-1d74544c607f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.541375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.542017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.542304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.542825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.543497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.543811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.546061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.562907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 117/240] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.568076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.609369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5005e-75fd-472d-b3ed-373668a932e8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.651467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.699426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3defb9-3ccd-458d-b4dd-5a241dcc6b1a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.719611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.720273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.720563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.720843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.722013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.723474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.725377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 124/241] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:02.733133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.735403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.736059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.736469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.736755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] PATH_INFO: `/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.751902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] RBAC: Authorizing `identity:get_user(user_id=483f4c47fc0a49dc9a6bfa48c3f1c265)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.753373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.755427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 118/242] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.762411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.926387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822bf7-1e4e-4766-8cfe-40ce5ad22b14 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.940759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28e15f-c002-491c-b930-83084a6e0f13 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.941397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.953639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.965634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.966378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.966660 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.966934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.999467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.000184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.000473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.000746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.001411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.003034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.038964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.040557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.047515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 125/243] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:02 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:03.150699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 119/244] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:03.156516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.289774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b34b3-320b-4a59-a8c3-c0c150ba5ec6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.333788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.334479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.334765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.335038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.336926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.338419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68e73c-2da0-4351-98be-de3b8996d4f8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.340447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 126/245] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:03.346522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.369547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.459423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca6f8-dc75-4c11-abc3-b99dbfd13892 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.500071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.500687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.500970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.501248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.502000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=483f4c47fc0a49dc9a6bfa48c3f1c265) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:03.502321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.503769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b726f5-3550-404c-b5f2-db617570a9b7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.511789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 120/246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/role_assignments?user.id=483f4c47fc0a49dc9a6bfa48c3f1c265&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=234f99b117064815a664463400930dbc => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:03.573683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b29f-a069-4f94-9a80-f5f0633106b5 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.574054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b29f-a069-4f94-9a80-f5f0633106b5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.574268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b29f-a069-4f94-9a80-f5f0633106b5 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.576063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 127/247] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:03.582859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53530-4bca-46a9-94fe-ceaef20be52e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.583161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53530-4bca-46a9-94fe-ceaef20be52e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.583422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53530-4bca-46a9-94fe-ceaef20be52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.587557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67efd-3f95-4d8e-bfe1-070c8db452ff None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.587957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67efd-3f95-4d8e-bfe1-070c8db452ff None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.588338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67efd-3f95-4d8e-bfe1-070c8db452ff None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.590220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 128/248] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:03.599448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa7ea-460d-4a58-82ca-ff25b9d591b8 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.599883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa7ea-460d-4a58-82ca-ff25b9d591b8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.600272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa7ea-460d-4a58-82ca-ff25b9d591b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.612891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-eef53530-4bca-46a9-94fe-ceaef20be52e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:03.615001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-eef53530-4bca-46a9-94fe-ceaef20be52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:03.625182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-315fa7ea-460d-4a58-82ca-ff25b9d591b8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:03.626435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-315fa7ea-460d-4a58-82ca-ff25b9d591b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:03.667540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.706473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 121/249] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:03.734157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 129/250] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:03.746692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bced5b-3604-4e34-a17f-4728cca0776f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.747219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bced5b-3604-4e34-a17f-4728cca0776f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.747634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bced5b-3604-4e34-a17f-4728cca0776f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.749438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 122/251] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:03.754672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.754968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.755249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.777004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:03.778233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:03.859963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 130/252] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:04.031483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bced5b-3604-4e34-a17f-4728cca0776f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.043211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.043673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.162427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.176157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a020-6923-469b-b757-2bf9645693b0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.208718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bced5b-3604-4e34-a17f-4728cca0776f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.243102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.243751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.244030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.244301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.270907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:04.275881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.276773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:04.278074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 131/253] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:04.278757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.281584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.282268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.282672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.282951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.314459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:04.319427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.320319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 123/254] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:04.321642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.420563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.472213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d21f-01f7-401c-8dde-7f858ae951ad None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.485238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b63124-29dc-4a35-83d2-d8a8bada8197 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.523990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.524632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.524914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.525188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.537150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:04.542499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.543391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:04.544184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 132/255] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:04.544829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.566716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.567358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.567640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.567911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.568597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:04.568902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.569313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.570880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.587754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 124/256] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:04.588615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.713561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ea97-6d56-4173-a724-4bd999079df1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.739572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954662d4-a1ee-4aaf-97c4-a65f6f8fef7a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.750849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.751770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.752254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.752728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.753627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:04.754165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.755844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.765615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 133/257] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:04.766905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.818174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.826008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.826008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.826008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.826008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.826338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:04.826338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.827234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.836703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 125/258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:04.837529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.890879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.923389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74217-be06-43ef-aa18-a96a3a518062 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.980033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.980589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.980871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.981146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.982652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.984147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.987238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 134/259] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:04.990403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.029658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42f0f4-f0ee-4909-8b72-80b7088d0003 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.128553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.130022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.130516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.131011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] PATH_INFO: `/v3/users/42fe685532e14662a123788552897db1` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.132388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] RBAC: Authorizing `identity:get_user(user_id=42fe685532e14662a123788552897db1)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.134087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.141998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 126/260] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/users/42fe685532e14662a123788552897db1 => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.142156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fb76-4208-4110-aecb-6529d8656a85 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.143271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.189188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.190413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.192102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.193352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] PATH_INFO: `/v3/users/6e0187d4761740588512b77a33b32201` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.195451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0187d4761740588512b77a33b32201)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.198513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.201187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 135/261] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/users/6e0187d4761740588512b77a33b32201 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.207104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.242424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.261587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.351455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0fdd-f7e7-40b0-a8dc-391d9f8d8818 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.376545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a0713-ebb2-4b98-b19f-d1c35460f81b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.395358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.396000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.396278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.396550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.397802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.399261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.400886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 136/262] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.403132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.436514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.437810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.438119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.438392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.563394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.564857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.570308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.627959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783fa43-0fbb-4aa5-9a1f-062c08c36b1f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.629984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.713653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.714324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.714612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.714891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.720596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 127/263] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:05.721541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.812300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.813894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c15985-98d8-4114-9dcf-6bb19d4f622a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.848547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a6da-a754-4a59-a7d3-69ee8403b43c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.886988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.887861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.888213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.888552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/42fe685532e14662a123788552897db1/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.891366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, user_id=42fe685532e14662a123788552897db1, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.892911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.901848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.913130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 128/264] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:05 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/42fe685532e14662a123788552897db1/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:05.914645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.942131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 137/265] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:05.943119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48020477-e2bb-49e4-a973-1a79aefcda74 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.943474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48020477-e2bb-49e4-a973-1a79aefcda74 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.943822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48020477-e2bb-49e4-a973-1a79aefcda74 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.950272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 138/266] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:05.950272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48020477-e2bb-49e4-a973-1a79aefcda74 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.986170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.124928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edae96-1564-40cb-974c-d34e8a861312 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.134672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48020477-e2bb-49e4-a973-1a79aefcda74 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.162639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.164107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.164683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.165160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.166551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.168426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98c98-99a6-4bba-adf9-27f249d4960c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.170854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 129/267] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.172582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ac4a-e0c7-4ab3-baec-351b63bccc11 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.172693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.173161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ac4a-e0c7-4ab3-baec-351b63bccc11 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.173411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.173761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.174033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ac4a-e0c7-4ab3-baec-351b63bccc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.174134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.175347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.176872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3167e-d354-4625-a08c-d6b03acc55a4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.178995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 139/268] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.180199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4b6d5-7aa2-4846-b252-077d20bcb3b9 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.180566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4b6d5-7aa2-4846-b252-077d20bcb3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.180910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4b6d5-7aa2-4846-b252-077d20bcb3b9 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.182592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 140/269] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:06.183473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4b6d5-7aa2-4846-b252-077d20bcb3b9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.195439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cbf4ac4a-e0c7-4ab3-baec-351b63bccc11 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:06.197114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cbf4ac4a-e0c7-4ab3-baec-351b63bccc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:06.248039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.290698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 130/270] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:06.298180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c0d6-00b0-41d6-80da-ad949a7ee803 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.298180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c0d6-00b0-41d6-80da-ad949a7ee803 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.298180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c0d6-00b0-41d6-80da-ad949a7ee803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.310921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6443c0d6-00b0-41d6-80da-ad949a7ee803 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:06.312159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6443c0d6-00b0-41d6-80da-ad949a7ee803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:06.318601 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4b6d5-7aa2-4846-b252-077d20bcb3b9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.325764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.362438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.363812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.364082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.364348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.365095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=6e0187d4761740588512b77a33b32201) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.365402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.366891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.378160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 141/271] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/role_assignments?user.id=6e0187d4761740588512b77a33b32201&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.378160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.408535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 131/272] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:06.409837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64dc8-d562-48b7-bcbf-0cdcbf64388c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.410038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64dc8-d562-48b7-bcbf-0cdcbf64388c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.410975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64dc8-d562-48b7-bcbf-0cdcbf64388c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.412503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 132/273] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:06.424991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.425282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.425544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.452664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:06.453950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:06.573918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd5580-a97c-403c-9b76-533fff7047b6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.583871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 133/274] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:06.598413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.623059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.670888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.678010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.678010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.678010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.678010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=6e0187d4761740588512b77a33b32201) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.678010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.681910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.694138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 142/275] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/role_assignments?user.id=6e0187d4761740588512b77a33b32201&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.765553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.790582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed38a4-8607-407a-a088-d4f714458011 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.834550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.835221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.835501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.835779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.847991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:06.853442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.854371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:06.855243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 134/276] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:06.863151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.994770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ce7cd-44b1-402c-a28e-245d75f0a5e5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.024760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.041636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.042722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.043220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.043744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.044617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.045143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.047449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.070266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 143/277] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.070266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.150936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.205317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e751-8a50-4916-b3d9-187dd2d1ea1b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.245785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a263-e298-44bf-be6d-2cf745c1c331 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.256111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.257245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.257868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.258361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.266020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.270175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:07.275383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:07.276263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:07.277027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 135/278] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:07.277677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.302823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.303541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.303828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.304098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.306660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.308014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.314145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 144/279] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.314145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.414032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059bb8b-6f29-4215-bf80-8a1709b9fc39 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.440962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885c20-e54b-4f93-b9a0-c4aa67960fc5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.449026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.456703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.457270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.457549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.457824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] PATH_INFO: `/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.459007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=483f4c47fc0a49dc9a6bfa48c3f1c265)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.460437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.462045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 136/280] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.466051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.484083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.484809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.485164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.485512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.486289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.486661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.488106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.496983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 145/281] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.497814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.540540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.581510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70e1a-41e0-4a3c-9a77-d47adf9e9dc4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.614267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9c05-1963-499c-93dd-dcae9edc02c7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.617305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.617925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.618234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.618507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.619160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.620591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.645346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 137/282] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:07 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:07.646246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.662288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.663326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.663789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.664503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.667133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.670140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.678838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 146/283] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.680071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.725501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.815509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127438-9b50-49c4-98da-eb7c1f28bd33 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.822296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6fe4-1140-4d44-aae8-e432af329d40 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.851520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.865702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619261-e272-46e9-858d-346c919b104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.868608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619261-e272-46e9-858d-346c919b104b None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.868608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619261-e272-46e9-858d-346c919b104b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.868608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619261-e272-46e9-858d-346c919b104b None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/483f4c47fc0a49dc9a6bfa48c3f1c265/roles/234f99b117064815a664463400930dbc` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.871780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.873448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.873448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.873448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] PATH_INFO: `/v3/users/dc67bded074d4a53b6f514aaf9e9ac21` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.873681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619261-e272-46e9-858d-346c919b104b None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, user_id=483f4c47fc0a49dc9a6bfa48c3f1c265, role_id=234f99b117064815a664463400930dbc)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.874983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619261-e272-46e9-858d-346c919b104b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.891158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 147/284] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:07 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/users/483f4c47fc0a49dc9a6bfa48c3f1c265/roles/234f99b117064815a664463400930dbc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:07.904655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] RBAC: Authorizing `identity:get_user(user_id=dc67bded074d4a53b6f514aaf9e9ac21)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.906982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34e6dc-ba44-4c75-a259-662799f2bb81 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.908781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 138/285] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/users/dc67bded074d4a53b6f514aaf9e9ac21 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.916084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619261-e272-46e9-858d-346c919b104b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.056417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.066352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619261-e272-46e9-858d-346c919b104b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.110155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.110770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.111102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.111324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.112102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, user.id=dc67bded074d4a53b6f514aaf9e9ac21, scope.system=all) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:08.112409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.113839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09b9b-21bd-480d-b68f-7a4dc1dd283c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.119706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 148/286] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/role_assignments?user.id=dc67bded074d4a53b6f514aaf9e9ac21&scope.system=all&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:08.174852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859dc5-dfdb-4170-ac42-611ea14d366c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.175189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859dc5-dfdb-4170-ac42-611ea14d366c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.175437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859dc5-dfdb-4170-ac42-611ea14d366c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.177227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 139/287] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:08.183931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.184207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.184487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.219656 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:08.220862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:08.343619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 149/288] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:08.658792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac859dc5-dfdb-4170-ac42-611ea14d366c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.848791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac859dc5-dfdb-4170-ac42-611ea14d366c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.896153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.897886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.898341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.898821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.922684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:08.927782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.928634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:08.929501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 140/289] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.935110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.078333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.090480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da003d4-443d-40ce-a40b-cafd11257e50 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.147080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.149987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.149987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.149987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.149987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:09.149987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.150329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.168346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 150/290] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:09.179133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.290344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.385894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf87dc-3f2a-4704-b9b6-3053e19d5927 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.431845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.432418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.432700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.432974 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] PATH_INFO: `/v3/users/42fe685532e14662a123788552897db1` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.438634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] RBAC: Authorizing `identity:get_user(user_id=42fe685532e14662a123788552897db1)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.440092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.442120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 141/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/users/42fe685532e14662a123788552897db1 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:09.447927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.570128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34903f07-f58d-4110-93b3-28bd18f05402 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.644564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.645192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.645474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.645751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.681434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.767257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.768746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.882807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 151/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:09.888370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.060861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a9da0-f8e6-4c00-a183-9b298ae7d30c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.095596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.102621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.103863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.104147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.104415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.105635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.107280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe864-8c35-4b7e-8515-b75191bf306b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.110019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 142/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:10.116187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.240657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.253939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abab82-3a63-4489-9493-988c17dba967 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.254272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abab82-3a63-4489-9493-988c17dba967 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.254527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abab82-3a63-4489-9493-988c17dba967 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.256008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 143/294] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:10.262555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109369-b430-42cb-aafd-7a5b4754e968 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.262836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109369-b430-42cb-aafd-7a5b4754e968 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.263110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109369-b430-42cb-aafd-7a5b4754e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.298874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a2109369-b430-42cb-aafd-7a5b4754e968 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:10.300462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a2109369-b430-42cb-aafd-7a5b4754e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:10.327619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642039b4-b8f6-430e-a57d-e62521648bcb None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.374717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.375714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.376773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.377253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.378531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=42fe685532e14662a123788552897db1) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:10.379317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.381753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0908-b7d4-40fb-964d-166d96787a81 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.391743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 152/295] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/role_assignments?user.id=42fe685532e14662a123788552897db1&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:10.393272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049dc5-9fb2-4453-9a66-1c194f4a4001 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.393756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049dc5-9fb2-4453-9a66-1c194f4a4001 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.394345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049dc5-9fb2-4453-9a66-1c194f4a4001 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.396140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 153/296] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:10.396736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 144/297] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:10.409204 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109758d-e7a2-4440-9c0d-1419581a5651 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.409811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109758d-e7a2-4440-9c0d-1419581a5651 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.410313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109758d-e7a2-4440-9c0d-1419581a5651 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.412204 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 154/298] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:10.413750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.415680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.415680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.417254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.417545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.417825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.438351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:10.440684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:10.475110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:10.476671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:10.525224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 155/299] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:10.602061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 145/300] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:10.701342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.752545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.814332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.819856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feec90-4971-491e-9215-b795a33fe9ce None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.865011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.865574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.865854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.866187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.867320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.868763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a429-4931-4fd9-b584-d16f68cfb247 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.870732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 156/301] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:10.871203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.871526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dbea1-0bd9-4e52-a968-c761023d2ea8 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.871807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dbea1-0bd9-4e52-a968-c761023d2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.872385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dbea1-0bd9-4e52-a968-c761023d2ea8 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.873525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 157/302] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:10.875993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dbea1-0bd9-4e52-a968-c761023d2ea8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.947516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a45e79-4cb7-4c48-a6d1-bf3d4d0dfb65 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.984231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.984879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.985158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.985433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.992876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dbea1-0bd9-4e52-a968-c761023d2ea8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.995854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-48d87158-bae5-4822-9acb-4939f94bbfed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:11.000792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.001671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:11.002837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 146/303] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:11.003548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.003837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.004114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.008687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.021998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:11.023220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:11.033004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.033690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.033909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.034245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] PATH_INFO: `/v3/groups` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.034882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.036335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.052932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 158/304] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Sep 1 15:30:10 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:11.053833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.099680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 147/305] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:11.105265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.149387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.193795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78eb9-8df4-42d1-82d8-5ca450fc27c7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.253262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.253911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.254220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.254557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.268708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ac28-94bc-4efb-9063-fbb94159bfbb None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.269570 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:11.275122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.276095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:11.276860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 159/306] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:11.282320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.318410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.319721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.320030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.320487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.322495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.323386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.323888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.325490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.337178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 148/307] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.343859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.410226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0d8d-efbf-42b3-a67f-34eb50ac2fd8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.446371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.446983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.447264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.447538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.448211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.448507 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.449867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.451893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.462345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 160/308] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.463188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.469621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e80c-a278-4fa2-b88f-dc8a3c93ee89 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.506534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.507520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.507986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.508334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] PATH_INFO: `/v3/users/16b9fd4ef264455d992d07cbb13dccbd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.522776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] RBAC: Authorizing `identity:get_user(user_id=16b9fd4ef264455d992d07cbb13dccbd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.524212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.531553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 149/309] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/users/16b9fd4ef264455d992d07cbb13dccbd => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.531553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.570774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.577709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada552-2964-4b46-bb47-207c12e02029 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.622335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.623414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.623712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.624018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.635464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:11.640890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.641871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 161/310] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:11.643160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.652961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2d19-8be9-40d9-954f-1692950175e6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.699991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.700728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.701014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.701286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] PATH_INFO: `/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.702743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] RBAC: Authorizing `identity:get_user(user_id=483f4c47fc0a49dc9a6bfa48c3f1c265)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.704405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.711247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 150/311] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/users/483f4c47fc0a49dc9a6bfa48c3f1c265 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.711247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.726640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.762365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452c55-ecab-4ccf-a09e-4a9c134a55f4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.808330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.809304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.809653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.810110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.810875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, user.id=16b9fd4ef264455d992d07cbb13dccbd, scope.system=all) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.811247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.813945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.819749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 162/312] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/role_assignments?user.id=16b9fd4ef264455d992d07cbb13dccbd&scope.system=all&role.id=234f99b117064815a664463400930dbc => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.831110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.834853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b96cb-ac49-4e91-b431-1a5400e3e10c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.880758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.907763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.908369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.908646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.908917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.909605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.909914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.912306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.934016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 151/313] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.939510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.029413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c0361-8b57-44ee-aa28-991ae171013e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.067650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.068590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.069048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.069494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.107756 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.144294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a45b2a-25ca-4e88-bdba-45da6f12582e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.178973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.181256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.215904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.216972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.217529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.218714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] PATH_INFO: `/v3/users/dc67bded074d4a53b6f514aaf9e9ac21` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.220404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] RBAC: Authorizing `identity:get_user(user_id=dc67bded074d4a53b6f514aaf9e9ac21)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.222178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.224672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 152/314] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/users/dc67bded074d4a53b6f514aaf9e9ac21 => generated 293 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:12.226700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.231123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.381727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a547-98ce-4196-ae1b-80ba8116e684 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.417681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.418465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 163/315] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:12.419103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.419612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.419769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.420266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] PATH_INFO: `/v3/system/users/dc67bded074d4a53b6f514aaf9e9ac21/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.422719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc67bded074d4a53b6f514aaf9e9ac21, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.424310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.439945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 153/316] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Sep 1 15:30:12 2022] PUT /identity/v3/system/users/dc67bded074d4a53b6f514aaf9e9ac21/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:12.606050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c49568-1d65-46eb-b0eb-e4a08b2a628d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.642067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.652870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.653710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.654186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.654624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.656665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.658763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136e8d2-361b-44d4-af05-d8e9da358e21 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.660914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 164/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:12.674346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.690343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.880016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e2f72-cd7d-4461-bcf9-e28e547c3420 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.002783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.003660 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.004069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.004500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.005379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, scope.project.id=56c0a06e6a1849dba1f374214b2684cd, user.id=483f4c47fc0a49dc9a6bfa48c3f1c265) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.005816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.007398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e6921-122d-423d-96fa-4be6137c998d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.036835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 154/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/role_assignments?user.id=483f4c47fc0a49dc9a6bfa48c3f1c265&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=234f99b117064815a664463400930dbc => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.189803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944910-fb40-47f5-8c73-ce9a73537e68 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.190097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944910-fb40-47f5-8c73-ce9a73537e68 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.190314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944910-fb40-47f5-8c73-ce9a73537e68 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.191690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 165/319] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:13.208178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f23c-f188-478c-b0fe-ba75955f0d4f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.209195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f23c-f188-478c-b0fe-ba75955f0d4f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.209702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f23c-f188-478c-b0fe-ba75955f0d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.259129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ed24f23c-f188-478c-b0fe-ba75955f0d4f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:13.261232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ed24f23c-f188-478c-b0fe-ba75955f0d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:13.506056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 155/320] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:13.818071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944910-fb40-47f5-8c73-ce9a73537e68 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.934506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944910-fb40-47f5-8c73-ce9a73537e68 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.945769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fab722-5fbd-4875-ae0c-e586c46deab4 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.946183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fab722-5fbd-4875-ae0c-e586c46deab4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.946527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fab722-5fbd-4875-ae0c-e586c46deab4 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.947952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 156/321] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:13.954120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.954840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.955319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.967683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.979794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.980437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.980715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.980986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.981817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:13.983917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.984044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:13.984651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.987514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 166/322] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.993055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.058956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.071830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 157/323] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:14.111523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d547fd5-716f-4f3e-84b1-a7c2e6018dcb None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.146501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.147138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.147422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.147698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] PATH_INFO: `/v3/groups` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.148360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.149845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.172333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 167/324] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Sep 1 15:30:13 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:14.343460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.455262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847549ff-8273-4471-a9d2-78cb924f29dd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.486814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.494080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.494746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.495030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.495303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.507983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-c5097673-41a3-4956-be06-75828a951b03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:14.513281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.514456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:14.515255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:14.515896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 158/325] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.520606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.546574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241550d-d45b-4a4a-bdc7-48124050dcb2 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.547194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241550d-d45b-4a4a-bdc7-48124050dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.547772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241550d-d45b-4a4a-bdc7-48124050dcb2 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.549629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 159/326] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:14.555306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.555826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.556223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.579580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:14.581981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:14.668168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac350-9c93-4ae7-b8b2-dcd724bc16c8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.673706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 160/327] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:14.702425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.736199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.736835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.737114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.737391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.738154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:14.738487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.739919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.750375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 168/328] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.755596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.889980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5937dd-fe39-4fff-9370-e1395cc9c8a0 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.919329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.934087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.934747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.935030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.935307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] PATH_INFO: `/v3/users/16b9fd4ef264455d992d07cbb13dccbd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.938319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] RBAC: Authorizing `identity:get_user(user_id=16b9fd4ef264455d992d07cbb13dccbd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.938319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.939912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 161/329] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/users/16b9fd4ef264455d992d07cbb13dccbd => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.947034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.988080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.110014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d210e02-9fa2-4a8f-8780-6adacec9ad45 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.152437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.155101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.156006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.159321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] PATH_INFO: `/v3/system/users/16b9fd4ef264455d992d07cbb13dccbd/roles/234f99b117064815a664463400930dbc` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.170045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=16b9fd4ef264455d992d07cbb13dccbd, role_id=234f99b117064815a664463400930dbc)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.170045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.173994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025ddab-abe0-426f-8edf-47b26bf18931 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.192811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 169/330] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Sep 1 15:30:14 2022] PUT /identity/v3/system/users/16b9fd4ef264455d992d07cbb13dccbd/roles/234f99b117064815a664463400930dbc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:15.229722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.230402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.230685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.230962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.247909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:15.253408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:15.254328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:15.255093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:15.256749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 162/331] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:15.260926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.315739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.409799 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ccd2a-86ef-476a-9348-2462c0d6e8e7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.457861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.458451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.458735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.459014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.459708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.460014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.461433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.472979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 170/332] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.478618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.552599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.636028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e063a89-1194-4ab0-8f6c-c8996b520c55 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.680653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.681670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.682239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.682753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] PATH_INFO: `/v3/users/dc67bded074d4a53b6f514aaf9e9ac21` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.686868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] RBAC: Authorizing `identity:get_user(user_id=dc67bded074d4a53b6f514aaf9e9ac21)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.690129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455c7d7-799d-4626-977f-1494265f8b20 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.690661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 163/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/users/dc67bded074d4a53b6f514aaf9e9ac21 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.696454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.846462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9000-ec95-47a8-bc79-700ac357f180 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.866368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.896146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.896780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.897070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.897351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.898137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] RBAC: Adding query filter params (role.id=6768cc46246246b384f2ab1b1e4861aa, user.id=dc67bded074d4a53b6f514aaf9e9ac21, scope.system=all) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.902382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.903854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47bf5e-dd60-4324-bd99-635aa932e482 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.917070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 171/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/role_assignments?user.id=dc67bded074d4a53b6f514aaf9e9ac21&scope.system=all&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.628103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1b459-d8d7-4507-921d-0431661f38aa None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.629178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1b459-d8d7-4507-921d-0431661f38aa None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.629178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1b459-d8d7-4507-921d-0431661f38aa None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.630150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 164/335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:16.635732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f19d6-c3bd-45a8-82e9-145b625fcf81 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.636169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f19d6-c3bd-45a8-82e9-145b625fcf81 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.636344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f19d6-c3bd-45a8-82e9-145b625fcf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.667610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-040f19d6-c3bd-45a8-82e9-145b625fcf81 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:16.668795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-040f19d6-c3bd-45a8-82e9-145b625fcf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:16.800297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 172/336] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:17.276570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1b459-d8d7-4507-921d-0431661f38aa None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.352569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e363da-d706-41f5-9747-cf1b24344d6b None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.352905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e363da-d706-41f5-9747-cf1b24344d6b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.353361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e363da-d706-41f5-9747-cf1b24344d6b None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.354990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 173/337] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:17.363324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.363608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.363886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.407032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:17.408229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:17.439602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1b459-d8d7-4507-921d-0431661f38aa None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.470486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.507669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beac84-5409-4872-975c-df050972265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.508716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beac84-5409-4872-975c-df050972265b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.509195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beac84-5409-4872-975c-df050972265b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.509683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beac84-5409-4872-975c-df050972265b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.540672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 174/338] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:17.541331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17beac84-5409-4872-975c-df050972265b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-17beac84-5409-4872-975c-df050972265b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:17.550895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:17.551807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:17.552581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:17.554898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 165/339] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:17.563049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.596684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.624520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8564-2ac5-49b7-a1ca-7580c19c6f4f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.625162 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8564-2ac5-49b7-a1ca-7580c19c6f4f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.625636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f8564-2ac5-49b7-a1ca-7580c19c6f4f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.627469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 166/340] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:17.645896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.646937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.647430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.694418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:17.696821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:17.713196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7a4b7-f3cc-456d-a3ea-381d73fab929 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.786679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.787609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.788022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.788429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.789241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:17.789696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.791291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.805265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 175/341] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:17.812772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.863772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 167/342] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:17.958716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.976007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd2545-e38d-4ae5-9e6b-64619af87143 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.025555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.026198 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.026480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.026746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.035422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.131919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.133390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.240303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469d11-27ae-4d7f-ab17-56cd4815238a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.268077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.278217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.308601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.308601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.308601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.308601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.308985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 176/343] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:30:18.314673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.330512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:18.335488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:18.336366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:18.337128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:18.342922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 168/344] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:18.349427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.454044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400cda1-252a-4f6f-89a4-4ac16765b64c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.500422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.501161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.501443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.501712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.502986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.504573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e0160-3cdd-4eed-845e-e225fd88e908 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.506507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4445-acd4-4faf-992f-7264a4c22a46 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.506642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 177/345] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.507719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b16bb-3dae-43e3-a203-3903a94a6d42 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.508088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b16bb-3dae-43e3-a203-3903a94a6d42 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.508363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b16bb-3dae-43e3-a203-3903a94a6d42 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.509898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 178/346] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:18.519245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.519557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.519795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.551621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806778-fa20-42b8-a166-01458300978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.551939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806778-fa20-42b8-a166-01458300978b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.552094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806778-fa20-42b8-a166-01458300978b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.555667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806778-fa20-42b8-a166-01458300978b None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.555856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:18.556014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806778-fa20-42b8-a166-01458300978b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:18.556014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806778-fa20-42b8-a166-01458300978b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.556322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:18.556477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806778-fa20-42b8-a166-01458300978b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.566742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 169/347] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.567652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806778-fa20-42b8-a166-01458300978b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.600987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.616708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.641584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 179/348] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:18.642861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.692357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806778-fa20-42b8-a166-01458300978b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.760267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.760558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.760808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.761140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.774321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350114-c14f-432b-828b-d2e0ad65afbe None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.796967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.798568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.800640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 170/349] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.801554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.815479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.816595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.817069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.817543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.830473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:18.835783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:18.836673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:18.837468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:18.839882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 180/350] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:18.840976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.899965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.969989 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc625-7e1f-42ec-84e7-4c8050ab7e76 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.980678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.993477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8521a19-9fcf-4555-8d70-5e8424501bfe None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.028551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.029662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.031066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.031810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.032762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.033380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.035659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.044347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 181/351] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.045187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.052934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.053674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.053992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.054264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.147705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.149211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.205559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696c81-43e4-4f2f-9f27-cefb6d548222 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.238451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.261000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.262130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.262555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.262965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.263650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.264202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.266587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802f327-a046-40e8-8a71-5d5459927e56 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.276255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.282635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 182/352] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.283986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d7fe-5ad3-4180-a7dc-b575feb7fec0 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.284355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d7fe-5ad3-4180-a7dc-b575feb7fec0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.284633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d7fe-5ad3-4180-a7dc-b575feb7fec0 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.285034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 171/353] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:19.285932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.294443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 183/354] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:19.296428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909d7fe-5ad3-4180-a7dc-b575feb7fec0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.421559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ae9a-45c4-40fa-9051-73b8faf8bd2e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.444810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909d7fe-5ad3-4180-a7dc-b575feb7fec0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.460284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.461293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.461582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.461859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.476550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f95b5b3a-e043-4655-b5a6-bfb22d40640a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:19.481184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:19.482184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:19.483254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 172/355] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:19.483991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860345a-8e8b-45a7-9d71-8d896b040888 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.484259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860345a-8e8b-45a7-9d71-8d896b040888 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.484541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860345a-8e8b-45a7-9d71-8d896b040888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.500533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.501194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.501477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.501809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.503011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.504463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.510256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c860345a-8e8b-45a7-9d71-8d896b040888 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:19.510412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 184/356] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.510412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.510577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c860345a-8e8b-45a7-9d71-8d896b040888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:19.573009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.583399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.611952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 173/357] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:19.614863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f701a-ed7a-493b-bacc-881e5bb7a171 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.615401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f701a-ed7a-493b-bacc-881e5bb7a171 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.615887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f701a-ed7a-493b-bacc-881e5bb7a171 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.618585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 174/358] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:19.619828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f701a-ed7a-493b-bacc-881e5bb7a171 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.664333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9ec6-76b3-427d-9702-6f8ad95956d6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.722571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.723200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.723498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.723761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.787500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f701a-ed7a-493b-bacc-881e5bb7a171 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.826423 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.828723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fca5-3fd7-41aa-9b5e-e4f979ff1eae None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.836666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.838164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.838711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.839174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.840029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.841052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.843748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.856213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 175/359] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.857729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.878739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.918191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.954588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 185/360] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:19.955400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.955683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.955951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.979460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:19.980683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:19.988844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c693840-6b9e-45f4-8870-a44dc65ead54 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.032691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.033342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.033623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.033898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.036175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.038987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.040143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 176/361] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.042410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.077027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 186/362] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:20.079366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.165579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.178042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec060d76-7fcf-467e-8862-ba6b5831d982 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.194161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.227923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.229074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.229423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.229766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] PATH_INFO: `/v3/users/16b9fd4ef264455d992d07cbb13dccbd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.231806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] RBAC: Authorizing `identity:get_user(user_id=16b9fd4ef264455d992d07cbb13dccbd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.233493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.241233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 177/363] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/users/16b9fd4ef264455d992d07cbb13dccbd => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.242358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.246767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80896419-601b-42fb-ba90-a0a686a7f0bd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.325261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.326422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.330186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.330694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.360995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:20.369433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:20.370362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:20.371142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:20.372963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff87-1bcf-47d6-8a3d-855e4165945f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.374361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 187/364] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:20.375610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.413006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.414452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.414452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.414452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.415373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.416799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.418729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 178/365] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.419512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.481817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.542636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3680-cca1-449c-8297-9f27c0619bd5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.553839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededad2e-4efe-4891-bbe1-cbf6d16494cc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.575506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.589931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.590589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.590937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.591285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.592101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.592931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.594418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.598924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.599649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.600027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.600415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.601243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] RBAC: Adding query filter params (role.id=234f99b117064815a664463400930dbc, user.id=16b9fd4ef264455d992d07cbb13dccbd, scope.system=all) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.601651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.602064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 188/366] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.603073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.603435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.621767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 179/367] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/role_assignments?user.id=16b9fd4ef264455d992d07cbb13dccbd&scope.system=all&role.id=234f99b117064815a664463400930dbc => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.622950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.750754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535100bb-e198-41ce-aec8-4fc6de20066d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.795489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.796738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.797012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.797291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.797999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.798313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.799731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.828914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 189/368] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.829812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.843413 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dd9b-910b-450e-8554-c1aa64d53022 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.860143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.918451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.932208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.932875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.933165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.933483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.950778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:20.959236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:20.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:20.960943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:20.964372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 180/369] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:20.965345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.984450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8f30-6d49-4d90-bb6e-6f4e6b0f4634 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.033842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.036648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.036648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.036942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.038305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.039675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.041535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 190/370] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:21.043113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.104788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8833459-3d71-4163-9ada-2fd02648a555 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.142688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.143310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.143597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.143874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.185325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5418d-7328-4a6a-b4f2-ecce5ef223c8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.189442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.212459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.231289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.233149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.235210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.236853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.237325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.237742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.238594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:21.239040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.240556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.253585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 191/371] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:21.254689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.379431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 181/372] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:21.379431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.395210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868153d6-f119-420d-ba3a-67828f4b634e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.440101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.440731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.441017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.441293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.442091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=56c0a06e6a1849dba1f374214b2684cd) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:21.442381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.443834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6f35-eaf6-41aa-8512-f3295bdca16e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.450144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 192/373] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:21.451303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf88e4-a12f-4e98-892b-f2be78d92040 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.451605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf88e4-a12f-4e98-892b-f2be78d92040 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.452975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf88e4-a12f-4e98-892b-f2be78d92040 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.453790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 193/374] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:21.455163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf88e4-a12f-4e98-892b-f2be78d92040 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.489381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.541514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad09ecc-1b69-4338-bc59-d01e9d9c61c6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.550391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.589615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.590437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.590820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.591195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.625109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf88e4-a12f-4e98-892b-f2be78d92040 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.671487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.675127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.675567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.675965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.678308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.679933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe3ca9-1a32-453d-9108-6a7d365b4cf8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.681734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 194/375] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:21.684229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.684768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.685234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.697799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.699838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.711188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:21.712381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:21.800311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.827453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 195/376] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:21.828822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.848462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 182/377] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:21.859656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.965244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.981380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295a59-08c9-4b34-8e8b-d98b740c1f65 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.026571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.027510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.027959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.028399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] PATH_INFO: `/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.031719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] RBAC: Authorizing `identity:get_project(project_id=05e98dd4fc624f4b8d51679e7ec2d59b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.033341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.036848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 183/378] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.068567 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.090867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99709f8-ac3c-4391-b221-aa3a4cac5a3f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.144952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.169292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.171269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.174072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.174543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.176975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.178661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.185347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 196/379] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.193340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.266557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed9a6a-8125-47d4-ac41-4f2209b6cac2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.313795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.314972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.315730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.316192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] PATH_INFO: `/v3/groups/2b143db2d8e04269adb09f9906576163` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.322249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] RBAC: Authorizing `identity:get_group(group_id=2b143db2d8e04269adb09f9906576163)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.324402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.328242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 184/380] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/groups/2b143db2d8e04269adb09f9906576163 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:22.329568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.335452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a58bd-9912-479f-a13a-fe0d842902c3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.354345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.386735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.387749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.388215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.388717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.390166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=56c0a06e6a1849dba1f374214b2684cd) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.390669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.393048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.401530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 197/381] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.402657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.533111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e6c-3456-492f-8057-7e39010738b1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.562981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.574212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0bbca-df96-4c8f-bbaa-f53c18d5a94a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.577047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.577988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.578497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.578974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.579940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] RBAC: Adding query filter params (group.id=2b143db2d8e04269adb09f9906576163, role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=05e98dd4fc624f4b8d51679e7ec2d59b) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.580476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.582196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.589849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 198/382] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/role_assignments?group.id=2b143db2d8e04269adb09f9906576163&scope.project.id=05e98dd4fc624f4b8d51679e7ec2d59b&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.633516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.634205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.634489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.634768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.651180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:22.656356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:22.657287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:22.658525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 185/383] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:22.664580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.724747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.809755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5766a-ea1e-45f7-8365-cc8a049d6513 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.849698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.850422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.850706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.850982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.851666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.851972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.853602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8c03-85ed-4b0f-81db-62ec353a96b0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.863963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 199/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.869538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.002402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f85f-486f-475b-bc53-8958d819be72 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.002402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f85f-486f-475b-bc53-8958d819be72 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.002402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f85f-486f-475b-bc53-8958d819be72 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.002402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 200/385] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:23.004709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.005029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.005305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.040710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:23.041942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:23.047493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbd5ad-98b4-4e60-8b34-bf3c5fce44f6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.117232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.117807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.118115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.118391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.122262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.128575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.130644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 186/386] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:23.138013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.201037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 201/387] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:23.203052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.312875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6e3d-f9a3-415d-a3fb-b6716aaef7f0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.387650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.388223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.388503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.388835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.390589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.392230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.393890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 187/388] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:23.399791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.455564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.559949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.617759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d216ea-d159-43af-8b8c-f25c606a1602 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.676719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.686919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09dbbc-4677-4394-9b07-288d1bc5af35 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.694300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.694980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.695257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.695527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/groups/d25b83435c0d4197a98e448b35fc56e7/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.701055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, group_id=d25b83435c0d4197a98e448b35fc56e7, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.704349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b862-95e0-4cd9-aae3-1bfee247f3d0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.727268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 202/389] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 15:30:23 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/groups/d25b83435c0d4197a98e448b35fc56e7/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:23.763248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e65df-18f2-49d4-b761-5220b76d9baa None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.763639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e65df-18f2-49d4-b761-5220b76d9baa None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.764020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e65df-18f2-49d4-b761-5220b76d9baa None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.767615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 203/390] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:23.769347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.770152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.770437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.770736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.777068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.777068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.777334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.808075 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:23.817649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:23.819501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:23.820462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:23.821285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:23.821927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:23.826449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 188/391] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:23.838831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.957486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 204/392] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:24.068017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e68c-c533-4565-abbb-927877c646c2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.128042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.128671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.128951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.133993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.133993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:24.133993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.133993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.141947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 189/393] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:24.149865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.194436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.316502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa47ce-bb5f-4970-ba26-62d437017338 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.338475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.380088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.395297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.395960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.396242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.396518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.397665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.399159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.401074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 205/394] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.407779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.462049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b32-1745-4a21-a2e4-b6f608e1adff None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.501603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.504534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.504944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.505317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.521709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:24.536955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:24.538947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:24.540916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:24.549327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 190/395] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:24.551923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.625147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.639973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36c30e-fc34-4b69-9178-d101df31ad83 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.679880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.703654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0f61-9c2f-4a50-a314-9450619f9abb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.738722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.739075 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.739400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.739573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.739749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.739903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.740054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.740215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.740772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:24.741078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.742688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.746854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.748475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.750693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 206/396] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.752471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 191/397] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.759152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.760006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.878071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312f11b-b66d-4853-8960-d072540cecc8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.924151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.926130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.926472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.927474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.929396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.932119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.934528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 192/398] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.942875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.955223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.986211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ee4f-b096-498e-8674-e8d2047f9153 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.023626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.024703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.025186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.025729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/groups/d25b83435c0d4197a98e448b35fc56e7/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.029107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] RBAC: Authorizing `identity:create_grant(project_id=80c09bfbaef044e5bf982fa9a44e6c7a, group_id=d25b83435c0d4197a98e448b35fc56e7, role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.030960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47fca6-354e-4a79-8f09-9d92fe0aeb71 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.048526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 207/399] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 15:30:24 2022] PUT /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a/groups/d25b83435c0d4197a98e448b35fc56e7/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:25.051612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a704d-78ad-4c6f-8fcf-9f4b2f9bb38a None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.052619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a704d-78ad-4c6f-8fcf-9f4b2f9bb38a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.053323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a704d-78ad-4c6f-8fcf-9f4b2f9bb38a None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.055590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 208/400] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:25.057243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32470d6-78ac-41c9-bae0-85bed43df7f6 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.057725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32470d6-78ac-41c9-bae0-85bed43df7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.058167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32470d6-78ac-41c9-bae0-85bed43df7f6 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.060179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 209/401] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:25.063286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e006-2311-43af-9709-78d741668292 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.063732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e006-2311-43af-9709-78d741668292 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.064273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e006-2311-43af-9709-78d741668292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.067293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50696787-3044-4efd-ac37-2a5b7a7b302d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.089879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-42d9e006-2311-43af-9709-78d741668292 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:25.091139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-42d9e006-2311-43af-9709-78d741668292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:25.107064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.124222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.125751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.127841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.128367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.130127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.132175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2702e-9314-40f9-97dd-fbff3e443d72 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.134813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 193/402] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.136549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.137072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.137501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.162185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:25.163944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:25.180484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 210/403] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:25.181530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e006-2311-43af-9709-78d741668292 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.276473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 194/404] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:25.412191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e006-2311-43af-9709-78d741668292 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.472118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.472905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.473849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.474360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.474835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/groups/d25b83435c0d4197a98e448b35fc56e7/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.481097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.482631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, group_id=d25b83435c0d4197a98e448b35fc56e7, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.484831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.505626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 211/405] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 15:30:25 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/groups/d25b83435c0d4197a98e448b35fc56e7/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:25.628202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82bb7-3512-47aa-a193-a9104409fdf2 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.680853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.681420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.681700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.681992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.702047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:25.707773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:25.708658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:25.709438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 195/406] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:25.713745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.714754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.727700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.805482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.847393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cfeb-1045-4222-9827-2e6f666aef8c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.891389 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.892019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.892304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.892581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.893269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:25.893582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.895008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.913811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 196/407] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.922681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.944120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a376-0f79-415d-94db-431a1effb291 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.009971 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.010679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.010968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.011247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.042807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:26.048521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:26.049396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:26.050193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 212/408] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:26.056289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.151852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e33ecc-fd2e-4066-8d55-4a301c11d963 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.184560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.186056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.194108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.194806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.195026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.195299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] PATH_INFO: `/v3/groups/2b143db2d8e04269adb09f9906576163` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.196422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] RBAC: Authorizing `identity:get_group(group_id=2b143db2d8e04269adb09f9906576163)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.197972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b32a8-479f-4d76-a4c6-3943962a4cfe None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.199998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 197/409] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/groups/2b143db2d8e04269adb09f9906576163 => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.201385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977d1b-edfd-4090-800d-45ccd6e7b4af None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.202220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977d1b-edfd-4090-800d-45ccd6e7b4af None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.202498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977d1b-edfd-4090-800d-45ccd6e7b4af None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.207799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 198/410] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:26.207799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977d1b-edfd-4090-800d-45ccd6e7b4af None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.229912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3af3b-b3bd-449b-a801-260f1d2c33f5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.271700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.272577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.272987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.273389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.274253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.274717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.276241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496ef50-9369-4467-9eb4-d8645dbcd03a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.290465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 213/411] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.292039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.292473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.292916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.312539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:26.314015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:26.320096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977d1b-edfd-4090-800d-45ccd6e7b4af None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.357546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.358765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.359046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.359377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] PATH_INFO: `/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.360741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] RBAC: Authorizing `identity:get_project(project_id=05e98dd4fc624f4b8d51679e7ec2d59b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.362356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.364414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 199/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:26.365190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.405354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 214/413] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:26.406512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.437414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.479680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6009-f700-4ad2-96a8-2b95fde51c93 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.521419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.522486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.522923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.523325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.525789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.527407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.529140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 200/414] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.530818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.536460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.625100 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f301-5a47-4157-9744-2d14aa415ba1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.705774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.706465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.706746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.707021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] PATH_INFO: `/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b/groups/2b143db2d8e04269adb09f9906576163/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.712595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e98dd4fc624f4b8d51679e7ec2d59b, group_id=2b143db2d8e04269adb09f9906576163, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.714163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.723852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc89d-3746-42b1-b076-58c118f02d13 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.755318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 215/415] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 15:30:26 2022] PUT /identity/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b/groups/2b143db2d8e04269adb09f9906576163/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:26.766557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.768695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.773699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.775321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.775747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.776163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.777598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.779441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.782313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 201/416] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.787975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.916509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855bbf-db8a-4728-bba5-d6c542de797e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.955464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.956134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.956425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.956703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd/groups/d25b83435c0d4197a98e448b35fc56e7/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.959062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=56c0a06e6a1849dba1f374214b2684cd, group_id=d25b83435c0d4197a98e448b35fc56e7, role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.960554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.979025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 202/417] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 15:30:26 2022] PUT /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd/groups/d25b83435c0d4197a98e448b35fc56e7/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:27.030395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46291b-84a0-41e5-9587-e7e94429b142 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.054283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.083061 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.083719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.084043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.084371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.097999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-255b656c-f7e8-4c05-9048-c67260e105fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:27.103563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:27.104414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:27.105203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 216/418] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:27.114423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.218360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.280787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff3817-c660-4f2c-9aac-7211bf21e7f2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.313396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e18a0-98c8-4d94-bf78-233e20ee72ec None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.313903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e18a0-98c8-4d94-bf78-233e20ee72ec None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.314543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e18a0-98c8-4d94-bf78-233e20ee72ec None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.315900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 217/419] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:27.323612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.323903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.324251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.327197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.327817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.328097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.328373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.329052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:27.329354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.330754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.341465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 203/420] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:27.346693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.366859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:27.368175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:27.459586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d582-39e9-42f5-9f55-1f6dad6b20c3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.484460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.509801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.510447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.510845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.511121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.551719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 218/421] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:27.612558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.614336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813976-c4f7-4f13-9f10-a8cd5940e584 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.720605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 204/422] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:27.726705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.869299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a4f78-93c3-4f19-aad4-0ea4799d06a7 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.870009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a4f78-93c3-4f19-aad4-0ea4799d06a7 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.870500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a4f78-93c3-4f19-aad4-0ea4799d06a7 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.872320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 205/423] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:27.879449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.879736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.880013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.908105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239addb5-ae94-43f3-bca0-4824daadd928 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.921985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:27.921985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:27.927544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.950208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.994735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.995553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.995841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.996107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.997273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.999607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.003015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 219/424] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.008805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.061663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 206/425] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:28.062704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.178995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ab1b-67ab-480f-9a19-68d513afd752 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.222338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.223383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.225618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.226144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.253477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:28.265406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:28.266321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:28.267096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:28.271220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 220/426] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:28.275098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.348061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399bb8-f252-4ff6-b604-c6595324fd67 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.375552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.399717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.400748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.401230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.401720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.404837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.406344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.408111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 207/427] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.413135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.447997 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.532253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5225fd8-ef26-4cf4-afe2-86db7e975420 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.584176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.584821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.585103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.585377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.588375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:28.592522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.592710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508675a-a032-41c3-b32e-914620cf3097 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.592814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.610935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 221/428] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.612294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.657357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.660854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.661399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.661894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.687740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:28.692169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:28.693038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 208/429] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:28.694533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.819679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.824806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.832764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c23c5-e179-467a-80f0-de4d4fbcefb6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.850620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6497-598f-447c-9c0f-19a128cd572e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.881882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.882777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.883226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.883827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.884694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:28.885141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.886890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.902898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 222/430] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.904303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.919121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.919771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.920044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.920358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.073053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.073239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972240b-34eb-42a3-9f35-675d01a95f4e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.075374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3547dc-9243-4858-97e2-70bd6f73388b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.121076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.121703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.122006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.122286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.123117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] RBAC: Adding query filter params (name=member) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:29.123485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.125165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3193b-a7e7-4c42-8b80-a892fd616365 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.139665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 223/431] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:29.144019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a536-97cd-4a79-bf47-16f3d530a4be None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.144019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a536-97cd-4a79-bf47-16f3d530a4be None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.144019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a536-97cd-4a79-bf47-16f3d530a4be None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.144399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 224/432] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:29.145138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a536-97cd-4a79-bf47-16f3d530a4be None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.191381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.192054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.234037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 209/433] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:29.234037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.234037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.234037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.259747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:29.261121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:29.333232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a536-97cd-4a79-bf47-16f3d530a4be None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.356585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 210/434] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:29.360039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.375605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.376103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.376103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.376315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.476352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.477814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdd60e-ed77-4b51-9758-c349044f0494 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.495046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281462d3-4251-408f-bb50-f4a9305b37e9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.509878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.511221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.560605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.560837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.561085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.561318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] PATH_INFO: `/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.562697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] RBAC: Authorizing `identity:get_project(project_id=80c09bfbaef044e5bf982fa9a44e6c7a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.564287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ec88e-5423-4ace-b043-c1d646782e65 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.574518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 211/435] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/projects/80c09bfbaef044e5bf982fa9a44e6c7a => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:29.574518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ef1c-5ac0-44d4-a38d-915609c860cf None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.574518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ef1c-5ac0-44d4-a38d-915609c860cf None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.574518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ef1c-5ac0-44d4-a38d-915609c860cf None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.574518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 212/436] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:29.577012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ef1c-5ac0-44d4-a38d-915609c860cf None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.624642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 225/437] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:29.626467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.626960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.627455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.649092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:29.650357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:29.712634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ef1c-5ac0-44d4-a38d-915609c860cf None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.731571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 226/438] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:29.733475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.752204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.753129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.753532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.753905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.755152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.756634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.758617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 213/439] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:29.759391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.804921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.819464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.871901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b6fd-c645-4387-a2ed-abe60c752599 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.895995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f51884-793d-49a0-bb05-800be0a21983 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.919229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.920137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.920498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.920830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.924177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.925944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.932593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 227/440] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:29.932593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.941443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.942197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.942480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.942758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.954196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:29.959278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:29.960145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 214/441] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:29.965674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.060849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013cc2-3f1f-4204-ae7e-8304356a03c2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.077236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f179-03df-424b-98a0-780a72033748 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.085025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.088839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.102035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.102880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.104124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.104558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.105571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.106090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.108017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.116910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 228/442] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=80c09bfbaef044e5bf982fa9a44e6c7a&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.117757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.129926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.130655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.130943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.131215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.132531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.134049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.137149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 215/443] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.137149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.253366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af11515-aa80-4ff3-a1cf-d834c704fd54 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.264749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e632-38fc-419e-8648-31a3a585c1e9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.308447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.309078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.309364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.309645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.310360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.310667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.312567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.317283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.318287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.318648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.319573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.327820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 229/444] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.328577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.335814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:30.340769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.343323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 216/445] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.344096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.401380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.407692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.490402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a968b-3350-4f3e-b6e0-deeb559e8f79 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.511863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7f84-ddd0-4a4b-8f42-3b19a48252d7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.534647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.535269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.535551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.535828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.536562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=6768cc46246246b384f2ab1b1e4861aa, scope.project.id=56c0a06e6a1849dba1f374214b2684cd) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.536871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.538336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.544492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 230/446] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=6768cc46246246b384f2ab1b1e4861aa => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.545792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.555293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.556299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.556809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.557683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.655319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.656805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.701103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c045-b076-492d-99e8-d137f1bd3fb4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.703129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.732443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.756248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.756869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.758439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.758439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.758439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.758439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.758439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.777017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 231/447] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.783505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.811999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 217/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:30.817266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.941646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b081d2-987f-4783-a030-e9ebab7954d6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.962469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ebad4-ed5a-4f27-a1c3-609b0611ccb0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.980139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.980948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.981078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.981300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.004261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.005321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.005321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.005488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] PATH_INFO: `/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.006779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] RBAC: Authorizing `identity:get_project(project_id=05e98dd4fc624f4b8d51679e7ec2d59b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.008221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.014012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 218/449] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/projects/05e98dd4fc624f4b8d51679e7ec2d59b => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.015455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.018301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.033286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.061738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.063244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.132185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b5410-7b07-49ab-bfa6-46926322e284 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.171590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243909-606f-468b-b585-f019a1472619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.172233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243909-606f-468b-b585-f019a1472619 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.172493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243909-606f-468b-b585-f019a1472619 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.172758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243909-606f-468b-b585-f019a1472619 None admin] PATH_INFO: `/v3/groups/2b143db2d8e04269adb09f9906576163` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.174009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243909-606f-468b-b585-f019a1472619 None admin] RBAC: Authorizing `identity:get_group(group_id=2b143db2d8e04269adb09f9906576163)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.175453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243909-606f-468b-b585-f019a1472619 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.177206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 219/450] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/groups/2b143db2d8e04269adb09f9906576163 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:31.182927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243909-606f-468b-b585-f019a1472619 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.190309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 232/451] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:31.192202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.259361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.277860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.296760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243909-606f-468b-b585-f019a1472619 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.315522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6727ea-333c-44fa-8303-c93841c8ea92 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.335923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.336619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.337442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.337442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.338155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] RBAC: Adding query filter params (group.id=2b143db2d8e04269adb09f9906576163, role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=05e98dd4fc624f4b8d51679e7ec2d59b) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.338469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.339905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.346619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 220/452] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/role_assignments?group.id=2b143db2d8e04269adb09f9906576163&scope.project.id=05e98dd4fc624f4b8d51679e7ec2d59b&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:31.352075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.352735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.353019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.353550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] PATH_INFO: `/v3/projects/56c0a06e6a1849dba1f374214b2684cd` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.354801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] RBAC: Authorizing `identity:get_project(project_id=56c0a06e6a1849dba1f374214b2684cd)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.356292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.358634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 233/453] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/projects/56c0a06e6a1849dba1f374214b2684cd => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.365293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.478577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2c14-80c1-4ff9-89e8-b63b42f1dfe5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.522705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.523355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.523628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.523899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] PATH_INFO: `/v3/groups/d25b83435c0d4197a98e448b35fc56e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.525427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] RBAC: Authorizing `identity:get_group(group_id=d25b83435c0d4197a98e448b35fc56e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.526508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3c6b6-7936-4377-b46f-57f0c2d29ebd None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.528230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 221/454] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/groups/d25b83435c0d4197a98e448b35fc56e7 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.534865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.644288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2a76-164b-4436-b4eb-de2b37d18998 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.678756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.679377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.679658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.679934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.680664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] RBAC: Adding query filter params (group.id=d25b83435c0d4197a98e448b35fc56e7, role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=56c0a06e6a1849dba1f374214b2684cd) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.680970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.682452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e29c3d-0eef-4948-8760-1b1176c65d12 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.690930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 234/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/role_assignments?group.id=d25b83435c0d4197a98e448b35fc56e7&scope.project.id=56c0a06e6a1849dba1f374214b2684cd&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:34.666996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d73de-017b-43ca-b387-c14d5f3df406 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.666996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d73de-017b-43ca-b387-c14d5f3df406 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.666996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d73de-017b-43ca-b387-c14d5f3df406 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.667930 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 222/456] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:34.685648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb6b58-4283-4cba-8d7a-33748c5830f4 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.685648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb6b58-4283-4cba-8d7a-33748c5830f4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.685648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb6b58-4283-4cba-8d7a-33748c5830f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.711064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-00eb6b58-4283-4cba-8d7a-33748c5830f4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:34.712277 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-00eb6b58-4283-4cba-8d7a-33748c5830f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:34.714780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.839513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 235/457] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:34.847252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768265-b478-4587-a0f9-bfcc5f654e63 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.847536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768265-b478-4587-a0f9-bfcc5f654e63 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.847813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768265-b478-4587-a0f9-bfcc5f654e63 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.849153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 223/458] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:34.859435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9deb-4ce0-4e73-8a31-d9c203be2bd9 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.859715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9deb-4ce0-4e73-8a31-d9c203be2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.860151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d9deb-4ce0-4e73-8a31-d9c203be2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.893122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-8c8d9deb-4ce0-4e73-8a31-d9c203be2bd9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:34.894640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8c8d9deb-4ce0-4e73-8a31-d9c203be2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:35.035904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 236/459] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:35.069590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb1e6-234a-4022-ad50-91224079a278 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.069590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb1e6-234a-4022-ad50-91224079a278 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.069590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb1e6-234a-4022-ad50-91224079a278 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.070396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 224/460] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:35.079494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.079784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.080059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.114463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:35.115660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:35.232020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.242535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 237/461] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:35.269623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cb1e6-234a-4022-ad50-91224079a278 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.282396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.387032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.475586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cb1e6-234a-4022-ad50-91224079a278 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.535327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.539196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.539791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.540251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.556485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.561288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1fe2f-85c0-4554-bea5-502073f4b164 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.561612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-182d5ff3-6ff6-4482-8946-2cb4d698a9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:35.589062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:35.590059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:35.590906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:35.590906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.590906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:35.593385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 225/462] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:35.595960 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3da58-fc1b-4e78-a89e-68167af3dcc5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.596472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3da58-fc1b-4e78-a89e-68167af3dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.598046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3da58-fc1b-4e78-a89e-68167af3dcc5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.604475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 226/463] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:35.605546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3da58-fc1b-4e78-a89e-68167af3dcc5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.618947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.619616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.619897 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.620172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.633573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.634920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-19f8948e-6498-480b-bfaf-6c7a034a828e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:35.651574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:35.652519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:35.653353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:35.653353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.653353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:35.653353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 238/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:35.655295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.655295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.655295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.680594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:35.681808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:35.685447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.748521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3da58-fc1b-4e78-a89e-68167af3dcc5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.749715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.788826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 239/465] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:35.788826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.809821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.811805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.812098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.812379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.814347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:35.814347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.815811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.847159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 227/466] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:35.848109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.954990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defab1f1-1be0-4a17-ab18-1c9160f8d9a5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.004536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.005847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.006386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.006905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.008681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d475-257b-4b8b-a572-04d89aa5fb06 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.020894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.023338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.025780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:36.046218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:36.047191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:36.048003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:36.048003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.048003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:36.048003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 240/467] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:36.048215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.060316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.060964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.061291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.061569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.062301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.062572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.064026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96ec7c-6345-4ebd-8db2-53b70aa97bc8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.078497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 228/468] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.079823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975a56-1b8d-4de1-b96b-0ee6eefdcb90 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.080116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975a56-1b8d-4de1-b96b-0ee6eefdcb90 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.080395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975a56-1b8d-4de1-b96b-0ee6eefdcb90 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.082743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 229/469] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:36.082743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd975a56-1b8d-4de1-b96b-0ee6eefdcb90 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.097356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.176806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a783-5006-41af-9e3e-eceb593cbef9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.194872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd975a56-1b8d-4de1-b96b-0ee6eefdcb90 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.215175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.215833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.216192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.216542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.217833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.219414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.232973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.233740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.234115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.234394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.235045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.235351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.236731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.243458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 241/470] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:36 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:36.244512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.266951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 230/471] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.266951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.314596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.371525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.395257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6e172-28ff-49ed-9fe6-59335ed33209 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.411342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ea3b-e8b6-4df4-92ef-e5497de40715 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.453387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.454069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.454353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.454628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.463939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.465172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.466112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.466112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.466435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.469004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38841da2-122b-461e-8e8d-625b5a39d9d0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.471479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.473271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:36.496559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:36.497697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:36.498848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:36.498848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.498848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:36.499614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 231/472] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:36 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:36.501070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 242/473] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:36.501215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.501429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.501703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.502587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.544502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:36.549252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:36.695655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 232/474] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:36.696767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.712811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe76e16-bb50-44f9-a797-b63836cb3932 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.736818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.785585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.786419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.787624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.787624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.788386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.790929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.817822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.837002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 243/475] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:36 2022] POST /identity/v3/users => generated 248 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:36.885170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c161657-b726-45c3-86ee-ff3e68d2d57a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.942966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.944041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.944522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.945016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.945952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.946649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.948307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.974959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 233/476] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.980666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.019403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.129144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.156473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39508a9-3d4b-4cdb-b8e6-1ac8efce8dd0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.209214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.210001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb504-b1a5-4d98-88ae-19333729efa4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.210484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.210962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.211431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.212691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.215400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.226715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.sql.core [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:30:37.226715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 15:30:37.226715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [parameters: {'id': 'c94d528f1a174d52854c7e4ff4097da9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 15:30:37.226715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81790) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:37.250924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:37.251858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application yield resource Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise self.value Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application session.commit() Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:30:37.252737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:30:37.253625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:37.254516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:37.258912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [parameters: {'id': 'c94d528f1a174d52854c7e4ff4097da9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:37.261459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 15:30:37.263451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.265622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 234/477] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 15:30:37 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:37.265622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.300431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.301097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.301487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.301776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.302499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.304110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.337307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 244/478] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:36 2022] POST /identity/v3/users => generated 249 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:37.439102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccf5a-61b0-47a4-ab32-aa9b2ad5d69a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.487451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.488092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.488376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.488652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.502002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-716bc981-b5d8-4848-b2da-1fefa4e69ce7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:37.512029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:37.512988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:37.513803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 235/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:37.522374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.622765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.676397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c7dd-52da-4f1b-9202-745e1a936e29 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.715497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.718172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.718172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.718172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.718172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:37.718472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.719655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fa5e5-f29e-4a34-b3d2-f646f2e19a87 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.729241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 245/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:38.709491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e238f-4ab1-4831-b746-02888bddc9ee None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.710031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e238f-4ab1-4831-b746-02888bddc9ee None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.710147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e238f-4ab1-4831-b746-02888bddc9ee None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.711701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 236/481] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:38.719192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85bb1-900c-4b0c-bf81-58dc0b38a180 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.719658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85bb1-900c-4b0c-bf81-58dc0b38a180 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.719744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad85bb1-900c-4b0c-bf81-58dc0b38a180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.743609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3ad85bb1-900c-4b0c-bf81-58dc0b38a180 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:38.744827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3ad85bb1-900c-4b0c-bf81-58dc0b38a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:38.824434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 246/482] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:39.348857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e238f-4ab1-4831-b746-02888bddc9ee None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:39.354995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16b22-1712-437e-86e3-753fea5eaa6e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.354995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16b22-1712-437e-86e3-753fea5eaa6e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.354995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16b22-1712-437e-86e3-753fea5eaa6e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.355362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:39.355821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 247/483] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:39.361543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.362126 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.362641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.399035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:39.402381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:39.490165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:39.571236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 248/484] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:39.586072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e238f-4ab1-4831-b746-02888bddc9ee None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:39.665947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:39.666557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.666837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.667105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.683597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-5f4d1f97-5429-448a-a605-f54bb19a5e92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:39.688551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:39.689437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:39.690240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:39.698450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 237/485] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:39.704869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:39.921405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4db13-4574-494e-9ca8-f7cbb9ed8e36 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:39.962293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f047-c5ac-46f1-befb-7f25e673bd2d None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.962824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f047-c5ac-46f1-befb-7f25e673bd2d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.962824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f047-c5ac-46f1-befb-7f25e673bd2d None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.964417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 238/486] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:39.965490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:39.966154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.966433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.966815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.967489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:39.967790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:39.969153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:39.975428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.975738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.975980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.983694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 249/487] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:39.991828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.037986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:40.041040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:40.089851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.150031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.166258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 239/488] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:40.167005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.226459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ed0f-77a1-4cd1-b31a-25f719cc6b74 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.297110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.301981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.301981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.301981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.315186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.317338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-5591d375-1e4e-49f1-b4de-8b3c03c88daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:40.347108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:40.348041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:40.348864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:40.348864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:40.348864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:40.355421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 250/489] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:40.358777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c412e-4eee-434a-80e8-e472e15aaa8e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.358777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c412e-4eee-434a-80e8-e472e15aaa8e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.358777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c412e-4eee-434a-80e8-e472e15aaa8e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.367197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 251/490] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:40.368067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c412e-4eee-434a-80e8-e472e15aaa8e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.410671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a6f94-b37c-41e6-b5f1-0e6398744eab None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.467157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.470277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.470573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.470848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.485263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fcdf450b-1dcc-4688-940c-0fac9af9e950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:40.490475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:40.491350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:40.492132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 240/491] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:40.492767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.493301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.493301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.517378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:40.518999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:40.526554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.540944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c412e-4eee-434a-80e8-e472e15aaa8e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.582209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.583138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.583576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.583857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.584509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:40.584814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.586209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.590194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.599609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 252/492] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:40.600777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.610587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 241/493] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:40.611955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.750117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4391ad-bc65-457e-8a61-e64dac5ac4a4 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.757759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250c24-2e0a-4968-97b7-039004b6ed53 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.801463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.802098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.802239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.802407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.802674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.802770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.803022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.803306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.803568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:40.803887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.805836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43778-652d-489d-91d1-260ca8bee884 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.817749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:40.822876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 242/494] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:40.824157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d052-1ccf-4363-a74d-f81403fbfbf9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.824447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d052-1ccf-4363-a74d-f81403fbfbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.824724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d052-1ccf-4363-a74d-f81403fbfbf9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:40.825813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:40.826906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:40.827694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:40.834674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 243/495] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:40.834674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579d052-1ccf-4363-a74d-f81403fbfbf9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.834860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 253/496] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:40.836257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.851975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.902529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.967245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579d052-1ccf-4363-a74d-f81403fbfbf9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.967877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca48d-1b0a-4065-8498-65e68d5453c3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.007271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.007802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.008083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.008377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.012385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.013027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.013309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.013618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.016650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.018113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.024803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.026294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-46183ee8-f27f-428c-8840-3359ffcab540 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:41.031701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.032605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:41.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 244/497] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.034723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.034723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.035027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:41.050330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.051312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:41.052149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:41.052149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.052149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:41.053771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:41.055026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:41.056532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 254/498] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.057573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.121789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.127511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 245/499] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:41.128383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.174673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.186083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bf654-6b67-401c-8a28-cdf3b75a8062 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.248398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.249129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.249466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.249800 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.250576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.250975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.252407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.265724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 255/500] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:41.265724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.293065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f95cbc-37e3-460a-9899-0fc6adb78018 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.347706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.348394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.348756 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.349067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.360466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:41.365518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.366551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:41.367519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:41.368800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 246/501] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.369711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.417624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a013-cebe-412d-9347-b97013ab2038 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.441606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.455918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.456528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.456973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.457303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.458036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.458343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.459841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.471433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.478063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aa058-8b21-4f83-9caf-71fd20527fc5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.497091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 256/502] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:41.498483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.516670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.517182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.517645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.517905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.518578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.518878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.520249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.535250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 247/503] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:41.539031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.612329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddba26-ee48-4127-a086-d620fef936c0 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.642182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac716216-fd7f-4b31-9e0b-043c52df5fcb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.651134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.652610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.652890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.653159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.663629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.665056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:41.680207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.681313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:41.682296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:41.682296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.682296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:41.682455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.682555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 257/504] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.682555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.686469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.686601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.687123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.687832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.688139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.689517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.698111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 248/505] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:41.698958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.719751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.722233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.796709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c23fe-404a-4f44-a179-610125b93b4b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.815687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302461c-a9e4-479b-a86f-d5f095b22aad None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.832486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.833120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.833402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.833676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.850001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.850001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.853083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.853946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.854243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.854517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:41.875856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.876994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:41.878041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:41.878041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.878041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:41.879026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 258/506] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.879944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.935604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.937323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.956963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.972050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.992260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eb1a5-6544-4e3c-b83b-e1201cf426a7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.029734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.031118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.031389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.031669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.039561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.040996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.048330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 249/507] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:42.049455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:42.055235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.056290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:42.057452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:42.060984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 259/508] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:42.061803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.158576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76ab6-a630-4d44-a931-c7f7ba41c501 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.167835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c00c8-a58a-4e69-99dd-807b013de95d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.175968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.193605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.194253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.194531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.194805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.195441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.195741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.197103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.201880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.203364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.204198 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.204490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.209071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 250/509] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.210062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.217777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.219254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.222217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:42.234810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.235757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:42.236590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:42.236590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:42.236590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:42.236590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 260/510] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:42.236810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.314664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b8de-d4e6-4236-83bc-3d56d1bff17d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.341096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5e67-fa4a-47d2-8402-9f08c3d1f2c7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.347724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.348324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.348658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.348933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.349568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.349869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.351276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.363577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 251/511] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.364319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.379217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.379849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.380128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.380394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.390648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.392095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.401594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:42.407215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.408284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:42.409114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:42.409114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:42.409114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:42.409114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 261/512] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:42.409561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.461229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.465220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caff94-997f-4bb5-8971-f3d27bb55b25 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.499522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.500119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.500397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.500672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.501388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.501690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.503136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.512438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5a4d-24af-4b48-9e07-f3be390c384c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.539559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 252/513] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.540388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.552377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.553014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.553296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.553570 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.561836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.563326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:42.574602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.575713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:42.576704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:42.580180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 262/514] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:42.581029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.633971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.640772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deb411-8287-4cb4-9bcd-847c0dc8c4ec None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.674192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.674801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.675082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.675358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.675997 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.676309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.677686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.679769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada497d-1a55-4367-ab8c-d34bcfb3c3d2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.690185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.697079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 253/515] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.697079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.715467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.716153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.716502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.716859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.717563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.719198 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.741088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 263/516] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:42 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:42.742279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.822835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106ea0-fafd-4bca-aa6d-df9555c9c73e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.858995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f875b-fc2c-4dff-a85d-59e5b384a8ee None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.861450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.862265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.862640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.863010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.863768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.864171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.865673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.882056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 254/517] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.882056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.902810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.905814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.906335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.907376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.907376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.947651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.989578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.991076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.003522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1cbf6-a8a4-47bc-a687-fabcb16204ad None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.042468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.043073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.043349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.043615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.044339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.044770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.046714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.069258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 255/518] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.069258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.115589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 264/519] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:43.116413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.163178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.199975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.200708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53427-8646-477a-ab0a-a3e7815c3d6f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.248521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.249378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.249672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.249939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.250726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec87405-9c0b-4f6f-8f9d-32232b34fe63 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.258221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.259724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:43.272461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:43.273388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 256/520] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:43.280307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.297430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.299041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.299400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.299745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.308377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.310313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:43.323870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:43.324753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:43.325596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:43.327096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 265/521] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:43.327096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.408419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186b16-13c7-4675-95cf-4fa29cc14b84 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.458011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.458628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.458912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.459185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.460203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8195-0c41-432e-b2aa-039643c2c9f4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.462076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.494352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.509226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.510043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.510430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.510804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.523721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.525181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:43.541635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:43.542728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:43.543880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:43.543880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:43.543880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:43.547737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 266/522] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:43.548815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.549089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.550711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.659802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 257/523] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:43.659802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.660060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d8f5-1a97-49a9-8ada-98f87679e1cf None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.698613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.700334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.701076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.701557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.702166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.702968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.703340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.704824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.725337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 267/524] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.731109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.767313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.775010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073539-f4ea-43ff-886a-54a3e09400cc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.819765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.820636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.820911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.821178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.822044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.822351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.824063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.837168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82fd8-c9f2-455b-84aa-44b809fca408 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.851206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 258/525] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.851206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.874097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.875926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.875926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.875926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.876250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.876556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.877987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.890537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 268/526] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.891226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.971022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.979183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40b5f-2e38-4b5c-a35f-791047e9b283 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.994917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.002096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31fe66-cf87-48e8-ac6e-eecc4893c1de None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.017804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.018579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.018860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.019244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.030451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.032122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.036256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.036864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.037144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.037417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:44.048763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.049765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:44.050679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:44.050679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:44.050679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:44.054898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 259/527] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:44.055721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.114050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.115518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.167009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8b8ca-17e0-4a9f-be35-c5d066c78aea None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.203091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.203820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.204222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.204499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.205346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.205653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.207132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.222278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 260/528] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.222555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.222721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.234655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 269/529] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:44.236254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.248375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.362897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b5c2-7710-47de-90e0-a71605f1c205 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.396604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fd7d6-cf02-4c08-989c-3f9d4035b064 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.404984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.405710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.406085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.406424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.416368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.418223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:44.436876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.437769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:44.438659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:44.442048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 261/530] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:44.443424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.444084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.444369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.444646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.445302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.445608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.446551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.447051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.465064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 270/531] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.465991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.528202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.567425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.588173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216534-e30f-4b75-bce8-056ef5b2908b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.602814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079566-6483-402b-9490-7a8a93ae6471 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.633587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.634694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.635185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.635683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.645641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.646450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.646870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.647159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.647861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.648148 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.648263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.649672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.650136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:44.665548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.666479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:44.667308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:44.667308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:44.667308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:44.669364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 262/532] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:44.670925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.676534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 271/533] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.677770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.786552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092d02-609f-451d-bc9e-49d1863f1628 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.800486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98714b-e1c5-4515-a049-16f2945bacb4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.808949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.816704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.823216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.824026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.824490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.824762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.831842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.833490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.837847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.838482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.838766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.839040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.839762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=2e3a994eec4a44b782d847b132c6eaaa) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.840073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.841999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7dd95-052b-4fb7-9e47-7060437abb81 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:44.845730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.846837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 263/534] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:44.847671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 272/535] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/role_assignments?user.id=2e3a994eec4a44b782d847b132c6eaaa&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6ba7-7b09-44f1-81f5-51eb6a2e4dfb None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6ba7-7b09-44f1-81f5-51eb6a2e4dfb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6ba7-7b09-44f1-81f5-51eb6a2e4dfb None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 273/536] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:44.858032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6ba7-7b09-44f1-81f5-51eb6a2e4dfb None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.983211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f0f0-205d-4727-8fa5-32e40a54d045 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.987062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6ba7-7b09-44f1-81f5-51eb6a2e4dfb None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.030696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.031320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.032472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.032472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.032768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.033079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.034924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da91cd-a538-49f5-aa61-932ed000bead None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.040879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.042092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.042610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.043666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.044549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.044893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.047000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.051888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 264/537] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.053053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.053338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.053614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.064425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 274/538] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.065260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.084394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:45.085639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:45.115889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.125796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.163792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 265/539] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:45.164767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.204159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9976c-7b14-47f8-b8bf-ef571e40dd0a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.245187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.246164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.246617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.247058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.255951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.257784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:45.273542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:45.274667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:45.275483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:45.277786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 275/540] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:45.284806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.359628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f798d-eaff-4185-8d91-34a754c540ee None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.430865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.431804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.432254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.432705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.433274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.434798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=17712d9631894617aa1011ac36582543) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.435312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.436860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.441977 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec074-f6f0-43aa-9a35-48208d274930 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.443963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 266/541] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/role_assignments?user.id=17712d9631894617aa1011ac36582543&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.479957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.480585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.480865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.481143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.481845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.482296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.484271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.497369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 276/542] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:45.503767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.554733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.569550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.641946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f83ff1-aea9-4b57-bee7-23c6c2f59a33 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.687249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.687866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.688140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.688410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.689140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=8908fc8044dc4428a53ef40cbcdff4c6) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.689445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.690903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.703154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 267/543] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/role_assignments?user.id=8908fc8044dc4428a53ef40cbcdff4c6&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.778225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca6638-af20-4dca-bd89-b1bf6242c79b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.833234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.833887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.834189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.834463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.854940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:45.860344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:45.861190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:45.862432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 277/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:45.869608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.014584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.018307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60bfd-4841-41fc-a093-bdb4d5b33cc7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.071051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.071813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.072096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.072370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.073048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:46.073411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.074834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.085812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 268/545] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:46.092113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.128667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.230787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1997d4-a2fe-43d3-922f-a65c1c3b6cf6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.283085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.283658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.283942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.284218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.299903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.301385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f358273a-c569-4189-804c-9cf842ed9ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:46.322289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:46.323215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:46.324036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:46.324036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:46.324036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:46.324036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 278/546] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:46.330147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.400268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394384d-bcc8-4ea3-a4f5-50887d948be8 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.400601 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394384d-bcc8-4ea3-a4f5-50887d948be8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.400817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394384d-bcc8-4ea3-a4f5-50887d948be8 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.402422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 279/547] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:46.407255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.407536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.407807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.427202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:46.428394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:46.445132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c328bd-6d36-4650-9334-773100457046 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.481119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.481729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.482079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.482399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.483055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:46.483359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.484721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.497059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 269/548] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:46.501475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.502335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.503199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 280/549] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:46.534586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.605119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887789-c1e8-48d6-9e2c-110b697de70d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.645063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.645704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.646014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.646298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.657247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.658710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:46.674306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:46.675728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:46.676760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 270/550] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:46.683061 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.819499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5bec2-dad0-443a-aa81-52f94b0f858d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.858728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.859695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.860194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.860672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.861605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:46.862137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.863748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.882382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 281/551] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:46.889995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.908854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.014339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.060144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.099427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a371-ccc7-477d-9cb6-aeace8d3f73a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.102088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9cbf-f0cc-400b-a6b7-49e6282f2839 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.161499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.162168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.162448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.162718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.211274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.211935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.212214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.212482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.238496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.240026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:47.240293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11199c-30cb-44cb-acbc-168330198f3e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a7f938e6-aece-4674-ad80-46790a8a4164 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:47.244919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:47.245948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:47.247175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 282/552] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:47.247924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014352-14b0-467c-83cf-94652b1ad3d0 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.247924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014352-14b0-467c-83cf-94652b1ad3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.248310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014352-14b0-467c-83cf-94652b1ad3d0 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.249362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 283/553] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:47.254135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e014352-14b0-467c-83cf-94652b1ad3d0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.336589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.362139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 271/554] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:47.363364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.363709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.363985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.381311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e014352-14b0-467c-83cf-94652b1ad3d0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.382150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:47.383331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:47.415567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.426696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.427233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.427516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.427794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.429188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:47.429520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.431759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.443334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 284/555] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:47.444356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.471956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 272/556] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:47.473458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.598635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff25c-d037-46c4-a9be-7da45c10dbc9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.631749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.643443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5732-f198-4d6c-887d-167c32db82c0 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.672929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.676154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.676633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.677117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.692381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.692381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:47.710653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:47.711588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:47.712439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:47.712439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.712439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:47.712439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 273/557] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:47.717454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.735598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.736251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.736531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.736804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.753208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.755921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-52d1db9d-7d77-4f4e-89aa-cec5ba85f8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:47.775903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:47.777293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:47.778176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:47.778176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.778176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:47.784352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 285/558] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:47.784352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6a04-d9d5-4f82-b8f5-92df169d87a8 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.784352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6a04-d9d5-4f82-b8f5-92df169d87a8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.784352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6a04-d9d5-4f82-b8f5-92df169d87a8 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.785417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 286/559] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:47.787300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6a04-d9d5-4f82-b8f5-92df169d87a8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.830105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.853206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b06c6-f3a9-44dd-8bb5-da9bcdbc0b98 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.890601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.891265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.891384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.891643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.892289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:47.892587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.893933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc64f6-c973-47c8-aafc-96245f050f9f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.907311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 274/560] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:47.908538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.908830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.909106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.919190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6a04-d9d5-4f82-b8f5-92df169d87a8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.927330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:47.928530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:47.947980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.958210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.958984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.959578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.959852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.960765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:47.961071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.963218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.980686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 287/561] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:47.981666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.007315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 275/562] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:48.008469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.100911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.110871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056a9c-dd40-42d7-a692-dfd93bd8ecb1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.118062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378506e3-5769-4d80-b2f4-c650e2ef73b2 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.149729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.150228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.150506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.150774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.157347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.157991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.158283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.158555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.162355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:48.165762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:48.167094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.168011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:48.170883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:48.171498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.171569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 288/563] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.171569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-489e441e-68e6-411e-a4cc-7041d19d111a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:48.183562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.184676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:48.185825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 276/564] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.190605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a088c0-b34e-46a6-a848-bbeb48738e9e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.190883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a088c0-b34e-46a6-a848-bbeb48738e9e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.191157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a088c0-b34e-46a6-a848-bbeb48738e9e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.196672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 277/565] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:48.196672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a088c0-b34e-46a6-a848-bbeb48738e9e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.210380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.294463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a845-edfb-4108-a9f8-62e812ccd423 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.300868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a088c0-b34e-46a6-a848-bbeb48738e9e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.330200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.330817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.331095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.331370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.335348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.335945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.336220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.336489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.337143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.337442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.338345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.338818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.339770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.346847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 278/566] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.347632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-fad4c85b-6b8b-45fd-abf7-51d270e51e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:48.351477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.352506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:48.353849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 289/567] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.354464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.354609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.354882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.373298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:48.374608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:48.381838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.426952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.443590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 290/568] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:48.444646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.456884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e90ed-33a0-4d8e-9eaf-7d43264071ea None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.491739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.492363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.492614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.492888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.493617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.493927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.495366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.512804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 279/569] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.514203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.574436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623d881-2943-4779-84e9-5a85385dae67 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.610766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.611504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.611947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.612188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.617850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc720d-1043-4a7e-a79c-baf34451d579 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.623129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:48.628527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.629494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 291/570] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.630734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.637217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.657248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.658067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.658456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.658836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.660803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.670796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.672273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:48.691693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.692754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:48.693769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:48.693769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:48.693769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:48.693769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 280/571] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.694036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.756251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699675-2ce2-4c57-a993-cc2d1e627f7f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.790565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.791302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.791679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.792030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.792716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.793019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.794478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.795091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664d56-3600-4417-bb8e-573c06f0b4d3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.806954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 292/572] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.807739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.828842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.829467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.829747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.830047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.840510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.842668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:48.857163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.858207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:48.864089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:48.864089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:48.864089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:48.864089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 281/573] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.864089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.872283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.902092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.913828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9f1e6-0ce3-4aa1-8bf6-c407d41c5153 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.947590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.948117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.948401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.948673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.949339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.949641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.951511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.960302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 293/574] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.961083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.961207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f524-8c86-4a03-9e12-46fd30aa5bcf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.996236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.996839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.997122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.997397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.998586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.998897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.000241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.011675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 282/575] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.012471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.066620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f241d-51dd-4409-8803-ff8b136ce882 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.091443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.102465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.103087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.103624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.103895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.110445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.114424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:49.114689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68120f2-3e44-4ab2-b9ec-bdd8a11d1f36 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:49.120027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.121131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:49.122002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 294/576] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.123190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.150201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.150815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.151099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.151376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.152102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=356ba9813a5740a2b6495debb9c1e5bf) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.152417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.153831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.159488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 283/577] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/role_assignments?user.id=356ba9813a5740a2b6495debb9c1e5bf&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.160144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.242218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a919c-3635-483a-a1f8-586cc056c40e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.275114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81307c-fcb6-4006-9f86-0e47cf7971d7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.281876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.282393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.282558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.282828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.283634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.283803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.285209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.298779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 295/578] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.300315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.317698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.318718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.319194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.319611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.331568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.333286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.348351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:49.349336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.350393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:49.351385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:49.351385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.351385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:49.358205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 284/579] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.359025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.378082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.409646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7dbc-5467-4158-b479-def945472e92 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.449234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.450330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.450603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.450898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.458898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.460337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.466393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9d47e-f1d9-4d23-9995-0fc6eca3ab11 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:49.474150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.475116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 296/580] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.481105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.512307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.512845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.513152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.514021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.514689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.514987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.516345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.524596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 285/581] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.525386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.592958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929cdd-c241-45d9-8811-8e742eddc251 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.595685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.610906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.630104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.630748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.631028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.631296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.637255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66fdd-a7e6-4fb5-ab11-1f28b4e55515 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.638771 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.640214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:49.651563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.652454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:49.653305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 297/582] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.653776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.681752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.682398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.682832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.683105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.683744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.684044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.685456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.701288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 286/583] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.702165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.772221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5c22-3779-4ef5-9776-9677a412ec53 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.808075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.808351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3937-a870-4d2a-8894-32de06ca01de None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.808719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.809002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.809276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.810685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.811719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.812542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.836457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 298/584] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.836457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.848712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.849342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.849628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.849908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.852611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.863141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.863534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.864573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:49.880047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.881007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:49.881879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:49.881879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.881879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:49.881879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 287/585] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.882504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.948011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417996fb-6729-4a74-9dcf-ee40a7ecbe5b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.986778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.987657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.988079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.988502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.989188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.989491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.990939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.995436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e869-4cb9-4c3d-8c9c-8d0e7c123add None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.008795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 299/586] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.008795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.030207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.031009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.031009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.031298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.039032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.040464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:50.052712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.053662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 288/587] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.054614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.099953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.111467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.120058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049ca8-814c-4f00-af1a-104024d8718a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.159473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.160282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.160637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.160919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.166992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce616266-bfa5-4028-b271-ed2466d9c20e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.173001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.174940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:50.193642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.194913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:50.201567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:50.201567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:50.201567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:50.201567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 300/588] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.201567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.205318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.205948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.206272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.206550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.207205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.207507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.208899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.227469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 289/589] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.227469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.317671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008836c3-6df3-46a4-b762-53e3259f4bd9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.334152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28504cbb-746b-4556-804a-dfc25c2d5cf0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.344191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.362645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.363311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.363591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.363916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.366562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.373688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.374376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.374652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.374919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.375644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.375946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.377355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.381457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=ba7d3b76b6b746f1b1c2585feef177b0, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.382918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.403528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 301/590] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:50 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:50.403528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.403875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 290/591] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.403875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.534843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5841-a995-473e-8597-ab004170cda1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.543417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fffc-e350-4e57-aee2-8f04070d04dd None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.586781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.587317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.587596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.587867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.588517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.588817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.590201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.593201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.594664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.595137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.595723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.604102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 302/592] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.604957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.610484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.612946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:50.629332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.630358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:50.631297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:50.631822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 291/593] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.632919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.665769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.671964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.732863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef90b-c483-4d85-a89f-d24df25a8853 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.767535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab09b-850b-40eb-95e7-dd1013b550c7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.768133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.768973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.769451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.769916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.782577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.784244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:50.802831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.803843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:50.804706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:50.804706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:50.804706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:50.804706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 303/594] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.804706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.808426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.809066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.809343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.809791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.818374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.820164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:50.834861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.835775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:50.836639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 292/595] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.837609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.921130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.927196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd80cfc-4531-4bad-8048-c28a8b5ed6bb None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.960939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.963854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.964665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.965177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.965558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.966437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e533b-9bc0-4f01-913d-40e3e123bcfc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.967239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.967648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.969183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.995685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 304/596] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.995685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.016065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.017053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.017544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.018025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.018945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:51.019425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.020972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.034840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 293/597] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:51.035932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.108408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fbcc0-c66e-443a-be9b-1ba6d23f93a8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.152616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c59560-e3b3-46f5-b69d-44258bb341ee None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.157600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.158495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.158781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.159183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.159865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:51.160064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.161607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.174395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 305/598] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:51.175226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.191978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.193672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.194356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.194607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.194914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.209284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.211509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.220174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8513439f-3162-48b9-bd3e-528d2fc60b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:51.230992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:51.231966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 294/599] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74813-2d98-4e88-b133-5fa982096eb4 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74813-2d98-4e88-b133-5fa982096eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74813-2d98-4e88-b133-5fa982096eb4 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.238276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 295/600] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:51.238978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d74813-2d98-4e88-b133-5fa982096eb4 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.288553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4a67b-b4cb-414d-9b49-e676665cb9b4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.328055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.328743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.329048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.329321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.336945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.338451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:51.352201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:51.353164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 306/601] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:51.354970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.363936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d74813-2d98-4e88-b133-5fa982096eb4 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.400376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.401045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.401326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.401605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/2e3a994eec4a44b782d847b132c6eaaa/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.416772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=2e3a994eec4a44b782d847b132c6eaaa, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.418329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e0ba-29ba-4fa2-9353-e7a5ec4f3482 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.431703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 296/602] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:51 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/2e3a994eec4a44b782d847b132c6eaaa/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:51.432651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.432944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.433217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.456177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:51.457664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:51.458894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.500491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa4ab-023d-4386-adc9-058cd09f2de9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.517872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.554607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 297/603] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:51.555678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.555807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.556832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.557343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.557843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.558764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:51.559272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.561495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.578703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 307/604] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:51.584653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.689207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ceff-9908-4436-9616-7de8f9be8a3e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.703216 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fd0c-8e76-4843-966a-0b8b91b33c33 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.727344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.727977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.728968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.728968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.729473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:51.729784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.731255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.743924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 298/605] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:51.745228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.746201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.746734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.747223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.749654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.756326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.758348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:51.771180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:51.772122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:51.773026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:51.776264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 308/606] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:51.784133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.787211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.805470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.861378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aa5f0-ad16-466a-b98c-273c5940b027 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.896946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.897619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.897903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.898214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/17712d9631894617aa1011ac36582543/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.914221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=17712d9631894617aa1011ac36582543, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.915689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.931068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 299/607] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:51 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/17712d9631894617aa1011ac36582543/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:30:51.936069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.993035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71756-450d-4213-8087-4b385e71b2fc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.046251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.047055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.049654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.051282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.052927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.053515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.056746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.072988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.083372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 309/608] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:52.089991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.096950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005a44-b995-49d6-9bf5-af21148dfa6d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.170556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.171204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.171483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.171755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.185601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:52.187593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:52.193674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:52.194854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:52.195710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 300/609] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:52.205118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.241394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148530e-7dad-4d1d-a68a-652022329ae6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.282914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.285505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.285789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.286091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/8908fc8044dc4428a53ef40cbcdff4c6/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.303636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=8908fc8044dc4428a53ef40cbcdff4c6, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.305415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.329261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 310/610] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:52 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/8908fc8044dc4428a53ef40cbcdff4c6/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:52.420129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b129419-e647-4d66-bba0-d77834cafdef None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.476825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.477457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.477743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.478041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.478988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.479358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.480747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73635727-c176-406b-b800-cb1c5d195f03 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.494136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 301/611] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:52.501136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.612382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b9eb3-1818-4de2-acbd-2a51a9d99394 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.614860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.654561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.655212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.655489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.655760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.666404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.667853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.681067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131517-0f09-48db-8dc2-0b8cb568946e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.682042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131517-0f09-48db-8dc2-0b8cb568946e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.682554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77131517-0f09-48db-8dc2-0b8cb568946e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.684542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 302/612] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:52.689922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:52.690860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:52.691735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:52.691735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:52.691735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:52.691735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 311/613] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:52.693488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.693841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.694384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.696557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.713435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:52.714814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:52.719269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.788391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 303/614] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:52.817737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7789b2d-f877-4b9c-97bd-6b11557caf74 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.853585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.854565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.855025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.855471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.856318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.856832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.859059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.873603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 312/615] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:52.878881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.980247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddb26-f1f6-462d-a078-e4c5bb9cfeb8 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.016324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.017237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.017694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.018250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.025585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.027235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.030534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:53.039977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.041118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:53.042277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:53.045315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 304/616] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:53.050675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.079020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.080349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.227538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145658-638c-4288-ba36-03fda8f652d9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.273241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9eaa-28ee-4e57-bbd7-e983fbaa5bc7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.292378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.292999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.293457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.293736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.294537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:53.294847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.296296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.334962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 313/617] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:53.342136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.347040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.348225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.348509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.348783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.373696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:53.389773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.390760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:53.391589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:53.392836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 305/618] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:53.413512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.470937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.496643 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9143-7bff-4e24-9068-2b27382c68bb None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.533232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.533878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.534272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.534551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.544423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.547049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.548751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:53.565522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.566679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:53.568160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:53.568160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.568160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:53.568160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 314/619] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:53.572498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.623796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9e59d-019b-486a-80f2-b9cf8fc77cc1 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.684842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdd37-794a-4d0f-b45a-d4378848b149 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.712904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.714636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.715956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.717072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.717582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.718513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:53.719046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.720645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.729983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.729983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.729983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.729983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.730365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:53.730365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.730365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.742021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 315/620] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:53.745249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 306/621] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:53.748642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.759231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.876041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72821643-8f64-49da-a1eb-8ff2869db818 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.917508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a83d-2c60-42e9-84ed-a8ca367e0fcb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.922681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.923417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.923837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.924175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.932391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.934158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.943025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-95811cd7-4566-456f-a7ca-d3fb08fca71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:53.954618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.955554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:53.956439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:53.957864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.958689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.958972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.959261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.959679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 316/622] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:53.961192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0a43-d17a-40f7-a101-066b733cf820 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.961683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0a43-d17a-40f7-a101-066b733cf820 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.962166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0a43-d17a-40f7-a101-066b733cf820 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.968308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 317/623] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:53.969510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0a43-d17a-40f7-a101-066b733cf820 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.979687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.979687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f9438927-e400-4464-9644-8c72c8798088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:53.995845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.997461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:53.999031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:53.999031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.999031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:54.002077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 307/624] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:54.003516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.003792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.004072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.024066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:54.025277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:54.055262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.105995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 308/625] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:54.105995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.131849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0a43-d17a-40f7-a101-066b733cf820 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.178044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.178906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.179328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.179739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.180574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.181650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.183495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.209664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 318/626] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.217110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.275745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796dac-88ca-4ab7-b843-f5b38f38a1b4 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.282333 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.365045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.365927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.366371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.366851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.367724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.368240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.369821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.384023 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 309/627] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.390440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.444091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5baf7-8257-4908-baab-b0336a8da2b5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.453597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.500749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.501585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.501870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.502422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/356ba9813a5740a2b6495debb9c1e5bf/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.521892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=356ba9813a5740a2b6495debb9c1e5bf, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.523426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacef9f-189b-4759-acd8-71ddfff6f1dc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.536177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169e15-f1c1-474a-b498-8b0713ba20cb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 319/628] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:54 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/356ba9813a5740a2b6495debb9c1e5bf/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414e97-84a7-4fcd-98e2-ed59d31dc792 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414e97-84a7-4fcd-98e2-ed59d31dc792 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414e97-84a7-4fcd-98e2-ed59d31dc792 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 320/629] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:54.545990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414e97-84a7-4fcd-98e2-ed59d31dc792 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.589015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.589675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.590980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.591812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.602397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.604452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-9ee8b2a8-e686-43ea-a202-fccbee545023 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:54.624453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:54.625527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:54.626576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:54.627149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 310/630] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:54.632132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.632132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.632132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.655672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:54.657392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:54.681274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414e97-84a7-4fcd-98e2-ed59d31dc792 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.695063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.754005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 311/631] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:54.754005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.766517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.767330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.767613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.767931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.779923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-6817ae41-ac7a-4a46-886b-1814d5b60cdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:54.785303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:54.786314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:54.787547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 321/632] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:54.788546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2592-6c37-4d34-9963-7e87eb48069f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.788546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2592-6c37-4d34-9963-7e87eb48069f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.788690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2592-6c37-4d34-9963-7e87eb48069f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.794124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 322/633] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:54.795147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2592-6c37-4d34-9963-7e87eb48069f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.814477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.870834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d85ea-b7af-4866-8285-653d0ca6d1ed None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.913363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.915153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.915443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.915814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.916683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.917234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.918548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a9873-836f-4254-9137-7fe7535a929e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.935436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2592-6c37-4d34-9963-7e87eb48069f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.942064 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 312/634] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.944132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.944626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.945108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.970261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:54.972057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:54.973154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.973891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.974347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.974717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.975541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.975946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.977606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.982429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.992292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 323/635] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.993299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.066309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 313/636] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:55.066309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.106769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.136817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc657b-7536-4a4e-a925-d1448203c7cc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.185458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.186528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.186917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.187293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.206290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af86f-6a1b-466c-8ada-4eee7ea4fcfe None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.248950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.249768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.250181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.250557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.261542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.263175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.265111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.277735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.280302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:55.281225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.282415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:55.283496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:55.283496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:55.283496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:55.289336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 314/637] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.290373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.371012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.398256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 324/638] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:55.399457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.416071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd00b-f0a3-4330-9f94-ead1554bad81 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.456229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.457292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.457570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.458052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.469211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:55.474417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.475357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:55.476177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 315/639] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.477255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.511993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155badec-0031-49a4-8dae-2c867ba93f0c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.535922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.549580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.550220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.550501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.550775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.551414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.551719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.553090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.564868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 325/640] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:55.567045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.583128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e80b-2a94-49cf-a762-e348382c6d9d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.615804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.621821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.622629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.622912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.623181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.634444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:55.640243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.641180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:55.642092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 316/641] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.642801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.682799 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e7f0-680d-40ce-8821-16513df9f232 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.723455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.724118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.724396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.724675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.737108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.738914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:55.754288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.755500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:55.756548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:55.756548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:55.756548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:55.759931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 326/642] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.760633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.765308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af052-e8b4-4eb1-a8df-fce78ad18df3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.781258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.805456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.806124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.806407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.806677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.807365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.807633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.809009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.818444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 317/643] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:55.823440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.858106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.873431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc7036-d038-4ad2-8e17-fba534bca9bc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.915280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.915923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.916200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.916470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.924123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.925566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:55.937720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.938879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 327/644] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.941557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.947970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63381-58b6-4579-804f-793800755bb2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.983592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.984301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.984649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.984990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.985723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.986149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.987886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.996141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 318/645] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:55.996955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.039133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.060371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815db85-9135-455a-abf6-53fc74eb10fe None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.101187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.102226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.102744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.103027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.103939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.104273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.104570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d372-852d-4dd9-8372-b8961f48337c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.105659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.119946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 328/646] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:56.120755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.133225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.146655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.147454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.147879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.148248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.159862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.161315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:56.175880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:56.177032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:56.178125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:56.178125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:56.178125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:56.178125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 319/647] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:56.178125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.231125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe7489-4d35-4307-b4a6-38488a45db24 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.267302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.267924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.268207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.268479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.269212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.269519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.270987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.285010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.293998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 329/648] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:56.294754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.298241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189551-64db-4b5d-8496-4b029ec73703 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.339058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.340046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.340498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.340955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.354599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.356043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.370154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:56.373278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:56.374457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:56.375526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:56.375526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:56.375526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:56.377932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 320/649] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:56.379028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.411291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85c748-2607-47ca-8045-ebe118c2c646 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.450774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.451720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.452218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.452686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.460141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.461826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:56.473711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:56.474719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:56.475787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:56.477789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 330/650] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:56.479084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.494985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a76cd-485c-4055-891c-4060a7d89fc4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.530447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.531062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.531343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.531615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.532254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.532560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.533910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.547111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 321/651] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:56.547761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.554259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.593859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb1d2-fae8-4500-a668-6deb1d8882e7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.620027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.628993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.629607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.629892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.630197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.652997 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80bff-9c67-4508-b4a4-4f0d668296e9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.689013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.689629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.689922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.690236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.690883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.691190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.692536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.699081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.700539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.703789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 322/652] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:56.704592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.769325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.804835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 331/653] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:56.805667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.808785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec6c04-9b4a-48c4-94bc-bf8a4496cbe5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.834143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.842179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.842788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.843069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.843343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.844032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.844341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.845776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af694dc-bb60-411f-a496-e4d0854dcf9a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.859253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 323/654] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:56.860467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2c9-58a6-441b-857a-ca6a9f5fbb7b None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.860753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2c9-58a6-441b-857a-ca6a9f5fbb7b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.861031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2c9-58a6-441b-857a-ca6a9f5fbb7b None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.862263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 324/655] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:56.862954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c2c9-58a6-441b-857a-ca6a9f5fbb7b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.913399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a19eca-6f04-499f-bc6a-56abb7c1cbab None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.946338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.946886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.947161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.947431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.954845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.956277 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.963375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c2c9-58a6-441b-857a-ca6a9f5fbb7b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:56.968183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:56.969094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 332/656] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:56.970074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.989483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.001371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.002026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.002307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.002577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.010337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.011939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:57.025287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:57.026521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 325/657] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:57.027668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.081266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.093683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b32ad-ff76-46e8-aefe-e22147abe4f6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.128846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.129481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.129768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.130078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.134831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b608e1-a13c-4261-a036-3a1194f0debc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.140464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.141930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0a11e60a-9c3a-4605-a4bd-feff6332faae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:57.156949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:57.158102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:57.159128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:57.159128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:57.159128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:57.159128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 333/658] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:57.159477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.159760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.160034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.173352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.173985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.174261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.174533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.175259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.175565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.176977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.178598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:57.179787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:57.182683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 326/659] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:57.183463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.235108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.262555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 334/660] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:57.263780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.306764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267d102-5cc1-4196-9a5e-6c5099018aac None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.356468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.357724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.358045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.358359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.359052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.359354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.360770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.384337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.388652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 327/661] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:57.388652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.421696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b354a4-b97e-4b29-b37e-d923f4790edb None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.465630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.466875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.467153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.467420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.468150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.468453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.470786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.492011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 335/662] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:57.496004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.515713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a4-55ec-4a48-b634-61732c081729 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.520090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.560838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.561455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.561735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.562041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.562690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.563098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.564385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.577557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 328/663] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:57.578431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.631147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4459a-2e44-42af-a3ac-406ce3ba3765 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.664574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.672890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.673512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.673798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.674108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.695283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049b04-1de0-4260-9dc7-e662171581b6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.731084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.731700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.731994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.732251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.749122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.750543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.765665 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.807920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.809366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.873885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 336/664] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:57.873885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.905954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.926090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 329/665] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:57.927045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.993833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eceb65-9a46-48bf-b44d-9199c61c2197 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.994992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.031448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.031994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.032269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.032535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.037205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c7d8-162b-4d0e-8eca-b3121a537749 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.043098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:58.048558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.049632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 337/666] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.051111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.083883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.084594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.084814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.085081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.092038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.093457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:58.106004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.107054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 330/667] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.107986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.152973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.167893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa406-c60e-4552-bce5-ea51cc15a14c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.202714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.203361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.203636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.203909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.214105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.215583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.216582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a8aa-d30d-4996-aff4-c0f6d0148f17 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:58.230353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.231323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:58.232244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:58.232244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.232244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:58.232244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 338/668] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.232244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.243872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.256797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.257441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.257835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.258196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.270124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.271708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:58.287987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.289180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:58.290264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:58.290264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.290264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:58.293769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 331/669] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.294719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.356645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f9490-4bab-447a-8958-10e413420cb1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.392975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.393588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.394963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.395260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.395953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:58.396263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.398158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.410784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 339/670] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.411780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.416590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.424543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d286a14-ec39-4562-b6dd-9602200f0d22 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.459834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.460453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.460739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.461015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.461713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:58.462057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.463505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.477050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 332/671] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.477873 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.515928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.536391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e111-eb75-4019-8c52-a1f54f211477 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.571693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.572525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.572946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.573463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.574489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:58.574935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.577096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.580608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e821-0ce0-4666-bd23-b951ed47259b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.594481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 340/672] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.595586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.617027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.617634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.617914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.618214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.618855 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:58.619162 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.620511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.631666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 333/673] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.632462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.665848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.712235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4891-b6c6-421e-bed3-e46f1e122194 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.740318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.748608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.749085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63145-c6d0-464b-b092-00d0e7e75b4b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.749254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.749543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.749817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.760227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.761687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:58.777108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.778250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:58.779401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:58.779401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:58.779401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:58.779401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 341/674] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.779401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.793859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.794843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.795260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.795774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.796755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=2e3a994eec4a44b782d847b132c6eaaa) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:58.797231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.798936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.805748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 334/675] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/role_assignments?user.id=2e3a994eec4a44b782d847b132c6eaaa&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.806832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.929097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cad841-140d-45ab-828a-90e08dec00fc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.948708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.950882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c282a-06f9-4903-889c-c39e568aacd6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.977188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.977830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.978173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.978696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.986465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.987926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.998902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.999908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:59.000168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:59.001002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:59.001890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:30:59.002384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.002384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.002527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 342/676] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:59.002527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.015958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.017460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:59.033800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:59.034775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:59.035658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:59.036108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 335/677] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:59.041249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.067540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.134620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e049af-5204-4a66-8e23-c6b4e0deeba1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.168287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb44a7-5a0e-415d-8a3a-5aee9ff45720 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.190872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.191870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.192357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.193380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.194549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.195086 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.197397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.208971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.209904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.210343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.210737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.211813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.212225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.214127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.215186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 343/678] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.220981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.234805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 336/679] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.235785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.277406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.334096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.342136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b954-ef11-4654-9b40-5b746e5763bc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.354279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea009c8-ac56-42f8-b9f4-f7606905cbd1 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.378586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.379506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.379949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.380362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.381303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.381870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.383469 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.389763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.390423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.390698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.390966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.397628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 344/680] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.398258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.399039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.399694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-bae9aaa4-769f-49d8-b9d8-043226ca469d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:59.415269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:59.416535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:59.417679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:30:59.421660 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 337/681] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:59.422971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c22f-3383-41b6-8706-615992631ea5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.423250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c22f-3383-41b6-8706-615992631ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.423518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c22f-3383-41b6-8706-615992631ea5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.424921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 338/682] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:59.425463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39c22f-3383-41b6-8706-615992631ea5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.513514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.521064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f48983-bcff-4888-a5da-8b92eecc1658 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.542935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39c22f-3383-41b6-8706-615992631ea5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.558722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.559337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.559632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.559894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.560614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=17712d9631894617aa1011ac36582543) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.560928 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.562397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.577990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 345/683] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/role_assignments?user.id=17712d9631894617aa1011ac36582543&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.577990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.592896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.593723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.594056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.594448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.595249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=8908fc8044dc4428a53ef40cbcdff4c6) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.595569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.597040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809e01-dcab-44b3-8f52-80507d50d0bc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.610411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 339/684] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/role_assignments?user.id=8908fc8044dc4428a53ef40cbcdff4c6&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.611853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.612151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.612492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.634386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.658682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:59.659940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:59.775887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ebd25-6575-452e-b9a4-ff6b33640943 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.803427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 340/685] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:59.820278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.820890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.821170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.821441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.823082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.823391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.824818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.844878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 346/686] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.849421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.967439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c0ca-af6d-405a-b008-61bb26435b29 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.007117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.008125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.008612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.009099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.012081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.094206 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.106067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.108405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.114786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.204032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0126a-12d2-48eb-b0f4-f0cc3c30330d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.273696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 341/687] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:31:00.274526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.275419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.275921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.276394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.285986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.308269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:00.315946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:00.319446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:00.320380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:00.321236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:00.322379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 347/688] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:00.330814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.397101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646fde1-6c06-4cc0-893e-3ac1846ea3dc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.436445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.437539 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.437829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.438177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.449447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.451602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:00.468885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:00.469874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:00.470822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:00.470822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:00.470822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:00.470822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 342/689] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:00.476336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.572882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.586316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.590821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60509-9c9c-4d02-8aeb-fb896f46481e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.629319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.629927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.630233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.630510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.631205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:00.631504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.632905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.646887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 343/690] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:00.652897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.691936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b5a43-efb8-4c73-8ecb-38942198f01e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.764068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abcef3-a7a6-4c93-80ae-3e806c056b69 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.801323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.801952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.802387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.802664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.810237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.812038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:00.823522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:00.826274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:00.828598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 344/691] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:00.834080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.834656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.834819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.843936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.863922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 348/692] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:00.875020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.946961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3588d-06c8-45ba-85e4-3fe02b446125 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.020369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.021160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.021357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.021512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.022220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:01.022523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.023953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c29e6-40a8-4cc9-a159-988f927a38d1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.041773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 345/693] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:01.043520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9841f5-388b-438b-9c0c-5ffaf948f649 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.044035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9841f5-388b-438b-9c0c-5ffaf948f649 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.045070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9841f5-388b-438b-9c0c-5ffaf948f649 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.050782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 346/694] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:01.051832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9841f5-388b-438b-9c0c-5ffaf948f649 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.079921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ffb4-8474-48f5-a484-b8ad5baa17c3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.117545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.118224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.118506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.118780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.126812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.127279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.131425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.133046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-abe226d9-9ce9-48c9-96b2-322225e49bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:01.150357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:01.151367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:01.152229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:01.152229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:01.152229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:01.156267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 349/695] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:01.157752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.157999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.158290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.171846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9841f5-388b-438b-9c0c-5ffaf948f649 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.176731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:01.177922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:01.212921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.214013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.216796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.217429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.218645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=356ba9813a5740a2b6495debb9c1e5bf) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:01.220112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.221857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.244332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 347/696] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/role_assignments?user.id=356ba9813a5740a2b6495debb9c1e5bf&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:01.245345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.289509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 350/697] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:31:01.461991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ec2d-47e3-445e-a21c-cc9f500d5ca7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.507092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.510965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.511584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.511881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.512142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.512797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:01.513623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.515986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.543552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 348/698] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:01.549388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.698368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c74ed-87d9-4841-b2ed-0afdb852f4c1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.720871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.737579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.738255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.738537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.741992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.746472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.748451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:01.761471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:01.762475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:01.764070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:01.766379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 351/699] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:01.774769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.851318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.935468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbda2c-e8e4-4b98-999f-632ea331f0cf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.979507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.980637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.981213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.981740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.982815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:01.983703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.985468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde889e9-8149-4a66-b3e9-59ca44580d04 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.006159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16b7a-cb15-482e-9b08-db2db92ba1c7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.009273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 349/700] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:02.010849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d40e1-dab1-45f3-9a61-734a78810d90 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.011388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d40e1-dab1-45f3-9a61-734a78810d90 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.011963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d40e1-dab1-45f3-9a61-734a78810d90 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.014377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 350/701] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:02.015294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d40e1-dab1-45f3-9a61-734a78810d90 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.056038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.056691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.056990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.057261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.075533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.077434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.078533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7362d208-87a5-4f29-94d6-2e7f4e55b677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:02.094984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.096195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:02.097249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:02.097249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.097249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:02.099863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 352/702] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.106429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.107598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.108087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.127516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:02.129212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:02.143444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d40e1-dab1-45f3-9a61-734a78810d90 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.164871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.184154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.184797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.185083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.185698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.209542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 353/703] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:31:02.210884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.280787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.282177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ffbf0-4034-45ee-9e93-1ef9e5dea955 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.332097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.348834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de8ac6-e0de-46da-ba99-05d5cc89fc6c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.390414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 351/704] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:31:02.391631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657ddea-451e-4ba1-85df-d22abe814242 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.391915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657ddea-451e-4ba1-85df-d22abe814242 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.392186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657ddea-451e-4ba1-85df-d22abe814242 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.397533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 352/705] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:02.397655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.397655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.397655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.397655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.397948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:02.397948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.397948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a721d6-24a2-4953-84e5-562a863da98d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.399724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657ddea-451e-4ba1-85df-d22abe814242 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.416086 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 354/706] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:02.417439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.417728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.418025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.437988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:02.439287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:02.462390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.511497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 355/707] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:31:02.512750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.531123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657ddea-451e-4ba1-85df-d22abe814242 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.576846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.578059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.578486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.578917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.595073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.597294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.612778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:02.623334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.624369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:02.625241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:02.625241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.625241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:02.627627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 353/708] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.628626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.647856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aef71-7275-4d24-afc1-003c6d838cae None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.699127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.699878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.700467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.700758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.701606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.703121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.733295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 356/709] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:02 2022] POST /identity/v3/users => generated 254 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:02.734955 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.746293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04748116-13a7-491d-8a14-380bb2b7c6a9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.749898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.800004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.800727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.801076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.801356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.802180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.804285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.819657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.820779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:02.822119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 354/710] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.826987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.872598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98255d-2e72-4e7f-9699-0a73b7c1b333 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.914634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.922495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.923200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.923582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.924012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.924778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:02.925189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.926817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.940993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 357/711] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:02.941850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.974624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0408322-2ac5-4545-aa85-94357df7ccd7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.024656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.025271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.025544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.025810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.026466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.026768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.028130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.031172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.033746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 355/712] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.034604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.069502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b7c6-4b3b-493d-9f71-60a6dd7b17ed None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.109491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.110551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.111037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.111526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] PATH_INFO: `/v3/services/network` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.112323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.113905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:03.125626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:03.126687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:03.127599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:03.130427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 358/713] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:03.131495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.167529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d26-bfe8-441a-9c9b-c106ce01c9f2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.203293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.212806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.214288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.214580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.214860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.223420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.225226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:03.240465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:03.241422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:03.242925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:03.246387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 356/714] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:03.247777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.255331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e9a13-43ec-4906-8e3e-b99511adfa90 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.289812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.297093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.298117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.298606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.299094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.299934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.300438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.302139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.308774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 359/715] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.310509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.379266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7b51-b170-46eb-b60b-03cd3e5f63eb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.421434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.422111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.422382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.422656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.423303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] RBAC: Adding query filter params (name=network) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.423607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.424989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.438572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 357/716] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.449051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.493118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef3de-302a-413e-8917-3e3753ec5484 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.532480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.533088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.533367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.533638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.534403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.534802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.536234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.550611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.552506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 360/717] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.558326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.618663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b852b-fd4b-4e8d-86c0-2b4bab007cca None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.644202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.667454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.668066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.668342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.668635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.669284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.669587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.670952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc4cd-97b5-4c7c-8470-94f717b72bb7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.677029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 358/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.748653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330c9b-b175-4a89-b6d2-f7e7df3bbded None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.797676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.798323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.798606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.798880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.799609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.799922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.801352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb2900-dfc5-4aea-941f-52528b7a9a2c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.807567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 361/719] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:03.829201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86860-0d24-4064-933a-18524cd3086b None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.829558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86860-0d24-4064-933a-18524cd3086b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.829764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86860-0d24-4064-933a-18524cd3086b None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.831553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 359/720] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:03.837574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.837916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.838151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.858505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:03.859742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:03.945180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 362/721] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:31:04.326268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc86860-0d24-4064-933a-18524cd3086b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.471251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc86860-0d24-4064-933a-18524cd3086b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.491341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.517063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.517707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.518012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.518295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.538899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:04.543731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:04.545147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:04.546000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 360/722] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:04.551191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.621528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.677482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275da34-c380-47ec-83dc-5ecf3ab34b71 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.714794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.715418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.715702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.716009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.717209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:04.717517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.718906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.728231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 363/723] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:04.733901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.869844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147000-7c41-4c98-9e25-2e781715bff5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.917129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.918144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.918637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.919191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.937056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.938864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:04.960752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:04.961868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:04.962797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:04.962797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:04.962797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:04.964905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 361/724] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:04.970536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.150258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec1c-8458-49ec-8f9f-08868027d779 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:05.170403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:05.197098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:05.197712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.198003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.198280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.198921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:05.199221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:05.201145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf4ca3-e226-44f3-adda-e1ecccbcf62d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:05.218267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 364/725] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:05.223648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.279593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:05.353208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d3749-4d83-4a43-97d3-e9fec550f53b None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.353801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d3749-4d83-4a43-97d3-e9fec550f53b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.354037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d3749-4d83-4a43-97d3-e9fec550f53b None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.355364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 365/726] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:05.361169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.361713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.362236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.382002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f0e61-2294-4313-8f3a-e354046308c2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:05.407275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:05.408922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:05.424834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:05.425400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.425674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.425942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.436605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:05.438078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:05.449955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:05.451001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:05.451934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 362/727] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:05.457154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.562726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 366/728] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:31:05.603167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:05.614266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2fba-28bb-45cf-9924-ac4dec2abea7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:05.655892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:05.656497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.656775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.657042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.657762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:05.658091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:05.659495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad1985-2d31-4e8a-9803-25928f8fd0af None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:05.678330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 363/729] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:31:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:05.686754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.777126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27501f-40be-4b73-895f-75c64a152cf2 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.777454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27501f-40be-4b73-895f-75c64a152cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.777675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27501f-40be-4b73-895f-75c64a152cf2 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.779095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 364/730] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:05.783945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.784348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.784623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.816103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:05.817302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:05.825121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1cb9-86d8-40c6-9dd0-b42343293fca None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:05.835381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:05.862910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:05.863623 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.863973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.864314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.930461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 365/731] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:31:05.931376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.949875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:05.952199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ade8b-fd21-41bc-b53e-8321a834b019 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.046792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.065620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 367/732] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:31:06.067594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85e82-0449-4bab-bcc5-657f79dd7f53 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.068097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85e82-0449-4bab-bcc5-657f79dd7f53 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.068582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85e82-0449-4bab-bcc5-657f79dd7f53 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.070560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 368/733] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:06.071617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85e82-0449-4bab-bcc5-657f79dd7f53 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.075140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.078915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797ab2-5ecf-4864-ae90-4b189bdcd981 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.126474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.127115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.127399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.127680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.142633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-25acf0a7-e942-4557-8e13-ea3da453d372 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:06.149441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.150433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:06.151283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 366/734] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:06.152472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.152472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.152710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.176956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:06.178472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:06.198106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85e82-0449-4bab-bcc5-657f79dd7f53 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.237501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.238184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.238465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.238737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.250859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.252327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.265519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 367/735] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:31:06.266401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:06.270432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.271356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:06.277063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:06.277063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.277063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:06.277063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 369/736] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:06.277284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.340529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.362721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.381388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c986c98-3242-4446-bea4-418e74184ccd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.413203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049a25-dcc3-49af-8365-48e863cb042d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.421294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.422082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.422364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.422641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.423308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:06.423611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.424955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.438427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 368/737] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:06.438427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.454860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.455638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.456242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.456687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.459084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.459294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2d2f1-8580-4d48-881e-df08807c521f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.479622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 370/738] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:06.481025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f589-84cb-41ea-be59-f992e804fa2f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.481322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f589-84cb-41ea-be59-f992e804fa2f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.481602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f589-84cb-41ea-be59-f992e804fa2f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.487104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 371/739] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:06.487104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26f589-84cb-41ea-be59-f992e804fa2f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.571040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625f8c-6504-442b-a9e1-e032748469b3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.602821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.626771 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26f589-84cb-41ea-be59-f992e804fa2f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.627434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.628061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.628352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.628624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.629828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:06.629828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.631002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10451836-1af3-471b-8f08-6977dfff9ca5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.639367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.650009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 369/740] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:06.650009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.650009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.650009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.667938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:06.668845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.669686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:06.670478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.670940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.671446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.688002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.689333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:06.705345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.706517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:06.707674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:06.707674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.707674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:06.707674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 372/741] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:06.707674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.754320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 370/742] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:31:06.755448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.851113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1542-8ba3-4756-a1f0-376f9d9a4c7c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.895716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5233e-73d5-4dcf-89cf-b146ad69b5ee None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.896249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.897042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.897639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.898102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.899825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.901378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.912345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.921878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 373/743] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:06.923010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.954658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.964870 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.965697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.965820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.966769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.982761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.984226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:07.006374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.007817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:07.008921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:07.013851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 371/744] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:07.019633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.053042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8004-c56c-4008-9304-e59a9bac6617 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.096156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.096820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.097093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.097325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.098011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.098323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.099838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.114907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 374/745] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.115912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.176045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42916-d1bd-42c5-b58c-4c254cd007f1 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.212382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.217519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.218105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.218390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.218663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.219368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.219675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.221123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.237707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c363-ab8b-492b-bc31-3ddfd46b19bf None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.246133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 372/746] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:07.247800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.282534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.284137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.284631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.285307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.288491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.299535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:07.308498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.309472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:07.310867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:07.314112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 375/747] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:07.314112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.387036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e15b-a091-46f2-b81d-c7d4d47c052e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.434312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.436944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.437392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.438115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.444857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebcb4-ca29-438f-8e57-7f706045586d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.448564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.450330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:07.465523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.466718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:07.467888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:07.475638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 373/748] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:07.475638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.493162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.493948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.494359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.495057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.496196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=356ba9813a5740a2b6495debb9c1e5bf) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.496632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.499556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.508607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 376/749] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/role_assignments?user.id=356ba9813a5740a2b6495debb9c1e5bf&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.508607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.521821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.620147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.630773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d27c2-d10f-4bad-baba-2a711c2e3508 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.707189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.707805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.708103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.708363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.709033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.709336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.710804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.721782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0432-a579-4ffb-85f5-36056ec6c6c9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.722093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 374/750] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.726445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.762847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.764310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.764827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.765314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.766293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.766806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.768446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.788290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 377/751] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.794536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.845940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899d95-a960-4227-ac07-03edac9b0fab None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.888414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.889067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.889458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.889740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.901587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.903180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.904051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:07.921049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.922273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:07.923256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:07.923256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:07.923256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:07.928502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 375/752] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:07.929554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.933728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.987765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762da77-6ca8-4293-b137-c0343c360edd None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.048838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed66d-3c7a-418a-a42f-50191a8bae9d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.068014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.069041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.069523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.070055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.090827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.091971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.092257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.092534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.093193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:08.093502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.096800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.111261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 376/753] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:08.116681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.196788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.243858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51b217-5d71-4027-b45b-31018d295690 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.247359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.249314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.283295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.283995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.284284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.284559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.293202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.295681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:08.310516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:08.311480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:08.312421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 377/754] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:08.318266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.393297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.427390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2cb8c-a97c-4264-ac99-cb97f2c5092b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.443529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 378/755] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:31:08.449411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.452707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.464494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.465021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.465305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.465628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.466481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:08.466751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.468218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.487513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 378/756] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:08.492919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.564596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f39d39-050a-481c-abc3-4f39182bf8b9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.597164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81f72-b88d-418a-9c55-697efb98ff32 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.604440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.605516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.613981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.614704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.627142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.629109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.633466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.634137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.634422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.634700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.645440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.646973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-bb268638-e2d5-4639-ac14-576032a7a337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:08.647795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:08.648690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:08.649568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:08.649568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:08.649568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:08.651739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 379/757] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:08.657989 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc814da-bf49-4ad3-9b36-9d6cf0fb5ed9 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.658712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc814da-bf49-4ad3-9b36-9d6cf0fb5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.659211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc814da-bf49-4ad3-9b36-9d6cf0fb5ed9 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.661000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 380/758] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:08.661927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc814da-bf49-4ad3-9b36-9d6cf0fb5ed9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-9630eea1-f845-42d7-8d1f-44cd74d0e7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:08.664237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:08.665154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:08.666497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:08.666497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:08.666497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:08.666497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 379/759] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:08.672253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.672595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.672876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.687030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.692702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:08.693741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:08.722467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.765941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 380/760] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:08.766893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.786619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc814da-bf49-4ad3-9b36-9d6cf0fb5ed9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.824340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.825487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.826062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.826535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.827379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:08.828010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.829753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.843827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 381/761] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:08.849554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.872586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900d7a6-5589-45fd-b3bf-604937d5c8e9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.909187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.909857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.910172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.910447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.911154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:08.911465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.912840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.924859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 381/762] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:08.930428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.939254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.957502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.968378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07982b-c371-4db6-9add-648ab4740a01 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.017463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.018599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.019099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.019634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.033933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.035738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.036541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46609a2-e57f-42a1-ac71-a60bbb554dbe None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:09.056172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:09.057127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:09.058031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:09.066358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 382/763] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:09.067861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.073065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.073065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.074227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.074227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.081777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.083310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f17c3739-0329-4cbb-aa37-6ee362579f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:09.101894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:09.102884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 382/764] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97224821-3ad6-4054-bea6-686220244c7e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97224821-3ad6-4054-bea6-686220244c7e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.104632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97224821-3ad6-4054-bea6-686220244c7e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.106194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 383/765] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:09.108285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97224821-3ad6-4054-bea6-686220244c7e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.192463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91508-884b-40c6-9db6-c3bb82bf5aca None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.198729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.217269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97224821-3ad6-4054-bea6-686220244c7e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.231963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.232950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.233370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.233641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.234378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:09.234688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.236128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38460a-8124-4d4e-a5c7-86243cf6abf9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.239119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.254925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 383/766] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:09.255661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.256234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.256342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.256517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.256713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.256800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.257035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.257507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:09.257821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.259284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.277947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 384/767] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:09.277947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.279412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:09.280671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:09.358919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 384/768] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:09.360036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.401040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1ce7-3941-4d61-a59f-54967b70432e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.439254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.440404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.440972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.441484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.444085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.446572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:09.462443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:09.463917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:09.464742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 385/769] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:09.465514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.481015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.489266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b3752-873c-4020-89a7-5842aec46218 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.517706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.528021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.528916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.529367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.529791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.530699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=99bd31cf5ff24090be9f73fa32514be5) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:09.531156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.532708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.538911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 385/770] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/role_assignments?user.id=99bd31cf5ff24090be9f73fa32514be5&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:09.539885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.583144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d017ec-e40c-4959-8701-c72ef17bb2b1 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.631394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.632281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.632649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.633015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.635217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=ba7d3b76b6b746f1b1c2585feef177b0, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.636993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.657922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360887-ba68-495c-a7e7-1f3755b34efe None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.668035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 386/771] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:09 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:09.702163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.703090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.703572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.704082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.704999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:09.705562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.707266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.713561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 386/772] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:09.721890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.747364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.821177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.879823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4257-96ce-4224-9e2a-936af7c3a08f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.912897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.919866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.920517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.920803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.921084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] PATH_INFO: `/v3/services/network` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.921681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.923106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:09.932825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:09.933833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:09.935309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 387/773] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:09.940689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.004143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e75d8-176a-44d2-9c7e-d62b5c4062f6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.049141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f338-5eb2-42f4-8be3-a66843449879 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.067959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.086970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.087657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.087936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.088217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.088858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.089168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.090650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.096186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 388/774] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:10.098811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.099521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.099822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.100138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.100829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.101172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.101805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.102784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.115256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 387/775] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.123670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.221898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565816b-399b-45fa-b2cd-795a002158d7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.258337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.258964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.259225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.259526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.260146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] RBAC: Adding query filter params (type=network) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.260456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.261841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.267390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 389/776] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:10.273071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.323356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.354789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae122344-0a92-4a2a-9645-059da62ffb8d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.379163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c70f0-6259-424a-b779-5a2b2d915291 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.415041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.415724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.416014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.416292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.417009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] RBAC: Adding query filter params (interface=public, service_id=d5248913c9f9451799e2bae3792bb950, region_id=RegionOne) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.417320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.418734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.429400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 390/777] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/endpoints?service_id=d5248913c9f9451799e2bae3792bb950&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.436323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.455274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.480990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.482489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.483027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.483623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.484915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] RBAC: Adding query filter params (interface=public, service_id=2392ae7e4c4346af91356deefd1ef4a6, region_id=RegionOne) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.485454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.490657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c852e6-d69e-4314-832d-10bcac2b5ef2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.499993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 388/778] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/endpoints?service_id=2392ae7e4c4346af91356deefd1ef4a6&interface=public®ion_id=RegionOne => generated 194 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.501254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01cf2-54e5-4ab5-9c46-cb66bf2cf82f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.501539 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01cf2-54e5-4ab5-9c46-cb66bf2cf82f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.501815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01cf2-54e5-4ab5-9c46-cb66bf2cf82f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.507308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 389/779] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:10.508160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01cf2-54e5-4ab5-9c46-cb66bf2cf82f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.564353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297875-cf3a-4919-82a3-d9cf204fda5b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.598383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.604452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.605094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.605376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.605652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.606313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.607741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55489ea-c34c-4c29-8400-efcf5875732e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.620444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 391/780] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.622292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.622582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.622859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.656220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:10.657460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:10.781699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01cf2-54e5-4ab5-9c46-cb66bf2cf82f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.803263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 392/781] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:10.835240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.835861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.836143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.836422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.837037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.839450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.848837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 390/782] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/services => generated 772 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:11.108111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.218581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02010b5-8007-4a17-a0a6-82c60f68ec5c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.221040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.267699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.268331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.268621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.268901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.284900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:11.289804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:11.290732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:11.291930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 393/783] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:11.297218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.398761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.454551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01dad-b0d0-4a6e-a5de-f259d5192266 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.499789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.500573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.500732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.500931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.501612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:11.501920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.503364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.517249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 391/784] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:11.522466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.661866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d784-8a89-437c-823c-e9448ddcb819 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.697106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.697758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.698064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.698339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.709856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.711661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-9f36effc-a477-43da-b863-8a934f71a8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:11.730362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:11.731346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:11.732962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:11.732962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:11.732962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:11.732962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 394/785] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:11.737795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.855498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8549c2-7b8c-407a-89d7-0edf9dc7a935 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.856154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8549c2-7b8c-407a-89d7-0edf9dc7a935 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.857175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8549c2-7b8c-407a-89d7-0edf9dc7a935 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.860118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 395/786] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:11.864533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf58e9-4093-4806-9e90-bc6594dddb1f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.865052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf58e9-4093-4806-9e90-bc6594dddb1f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.865556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf58e9-4093-4806-9e90-bc6594dddb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.886785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-1cdf58e9-4093-4806-9e90-bc6594dddb1f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:11.889462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1cdf58e9-4093-4806-9e90-bc6594dddb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:11.904082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.909755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea5107-9ad2-40c5-96d2-c252224d42f4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.957008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.975858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.976469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.976746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.977019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.977663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:11.977978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.979593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.985021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 396/787] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:11.986363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f77ac-d0f4-4da4-ae51-2bb26598f58e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.986651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f77ac-d0f4-4da4-ae51-2bb26598f58e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.986928 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f77ac-d0f4-4da4-ae51-2bb26598f58e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.988417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 397/788] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:11.992946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 392/789] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:11.993664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.993944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.994264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.998216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.037124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:12.038376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:12.151389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 398/790] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:12.170945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca43d7c-4af8-4ee2-b5d7-a41f76f66c13 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.206332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.206971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.207349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.207575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.215490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.217477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:12.229600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.230553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:12.231537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 393/791] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:12.236340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.312048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.316968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.341515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed16d9-480e-4564-bf40-d1c096c9eaf2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.363819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.380560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.381629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.382032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.382342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.383079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.383395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.384785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.404087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 399/792] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:12.411070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.432635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767908a-9bdf-4d53-b7dd-bee9d6390916 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.495889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.496943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.497505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.498829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.519011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:12.527571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.528979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:12.529822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:12.534925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 394/793] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:12.547029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.586942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9488d8-d2a6-430d-8672-d6291eaaa7f0 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.622733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.623376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.623654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.623924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.625855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.635432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.636873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:12.652472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.654197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:12.655255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:12.655255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:12.655255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:12.655255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 400/794] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:12.655667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.669661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2da9-446e-4bf8-9fe0-29f459551795 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.677037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.721110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.722073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.722566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.723015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.724055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.724658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.726218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.741112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 395/795] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:12.742339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.761652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7025363-78f3-4775-96db-32058ad7790f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.801244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.801884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.802235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.802505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.816459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:12.824123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.825761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 401/796] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:12.826743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.860173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ce51-d359-4d2b-9c83-dbd8cca788ce None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.875574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.900603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.901667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.902150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.902589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.903955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.904408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.905941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.919615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 396/797] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:12.920865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.934791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8476c-6d82-4a51-a963-d12487b48cca None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.948848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.971357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.971981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.972255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.972523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.984331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.985769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:13.001111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:13.002130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:13.003025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:13.003025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:13.003025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:13.007306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 402/798] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:13.008261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.041330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35dfb-48bc-40cd-b769-de87c83ef8c2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.080490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.081498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.082008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.082598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.083572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:13.084078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.085667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.096008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 397/799] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.097182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.128292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.132264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d86e4-0423-4be7-8cbb-3a429caa053a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.172947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.173622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.173907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.174215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.181171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.182692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:13.194659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:13.195607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 403/800] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:13.197016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.198607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.221460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdda51-aa3b-49da-9f40-64f129b558df None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.259386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.260323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.260607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.260878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.261536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:13.261869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.263307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d1246-aba2-4018-b19d-921391c3abe9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.279352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 398/801] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.281025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d0c0-652e-4d34-bafe-bd6bacb5a1fa None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.281492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d0c0-652e-4d34-bafe-bd6bacb5a1fa None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.281940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d0c0-652e-4d34-bafe-bd6bacb5a1fa None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.283848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 399/802] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:13.284897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68d0c0-652e-4d34-bafe-bd6bacb5a1fa None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.315854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda96-3b2d-4260-8f9d-064a1f4d6847 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.350581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.351212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.351479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.351752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.363258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.364725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:13.379411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:13.380557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:13.381678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:13.381678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:13.381678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:13.381678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 404/803] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:13.381678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.397697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.398240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68d0c0-652e-4d34-bafe-bd6bacb5a1fa None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.432871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.433478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.433765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.434070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.434760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:13.435066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.436489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923a960-797b-4e9a-9d6f-b926a86b6cba None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.447630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 400/804] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.448820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bee7-0f0b-4655-b62f-a75cbb97710c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.449118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bee7-0f0b-4655-b62f-a75cbb97710c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.449398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77bee7-0f0b-4655-b62f-a75cbb97710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.462392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.468345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-1f77bee7-0f0b-4655-b62f-a75cbb97710c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:13.469548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1f77bee7-0f0b-4655-b62f-a75cbb97710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:13.489163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159f6b3-ff30-44a2-9dd5-4a3962caed81 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.523061 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.523692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.523979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.524257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.533635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.535161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.537846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 401/805] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:13.539194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dae5-4600-4fb1-83c8-8e0a9ea890be None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.539430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dae5-4600-4fb1-83c8-8e0a9ea890be None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.539705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dae5-4600-4fb1-83c8-8e0a9ea890be None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.540942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 402/806] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:13.541625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034dae5-4600-4fb1-83c8-8e0a9ea890be None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:13.555019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:13.556046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 405/807] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:13.562022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.638383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.658066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034dae5-4600-4fb1-83c8-8e0a9ea890be None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.673334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d5be-51d7-4117-b934-72b95da63f6f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.703446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.704154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.704440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.704713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.705356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:13.705835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.707094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200f54-4242-4cdb-a2ed-beac230ac07e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.711960 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.713147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.714498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.714954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.715429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/356ba9813a5740a2b6495debb9c1e5bf/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.719134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=356ba9813a5740a2b6495debb9c1e5bf, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.721203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.733845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 403/808] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.733845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.733845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.733845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.742497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 406/809] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:13 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/356ba9813a5740a2b6495debb9c1e5bf/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:13.750035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.765380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:13.766899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:13.856206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 404/810] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:13.857132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.895201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c632d-df38-43fd-a631-894f67e12829 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.940895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.948240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.948879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.949426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.949743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.951377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:13.951734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.953243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.977985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 407/811] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.977985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.999032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefe57f-5857-4a9e-b084-03ef54ff7f70 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.033182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.043693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.044839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.045132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.045478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.053631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.055237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:14.068015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:14.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 405/812] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:14.070291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.120289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064f2f6-73fe-479b-9c9d-448b358d1380 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.166505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.167081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.167359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.167630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] PATH_INFO: `/v3/services/network` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.168226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.170427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:14.183901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:14.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.185896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 408/813] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:14.187204 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.199178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fce9-7903-4135-a7af-50fe6f2cb3f4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.239796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.240416 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.240694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.240962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.260522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.301930 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.316225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.317792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.319381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4eaa7-6f19-462b-ae1a-12fc9332ef26 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.356037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.356894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.357701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.357701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.358253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:14.358624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.360071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.377644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 409/814] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:14.378511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.432656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 406/815] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:14.434003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.495728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d144e-2531-416b-8571-4692b3a54404 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.508750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.527802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.536118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.536761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.537156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.537430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.538248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.539530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.543276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eeebe-7496-4ac7-8906-6dcfb072721d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:14.550073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:14.551052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.551881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 410/816] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:14.552694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.580179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.580791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.581073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.581349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.581995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] RBAC: Adding query filter params (name=network) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:14.582312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.583658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.590003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 407/817] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:14.590003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.670105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881f8b-80c9-46c5-a3f0-358f78ca792a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.700779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34162c-4226-4616-90f2-9fcbda0e7b06 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.709565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.710239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.710527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.710804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.722586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.724030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.737414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.738088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.738369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.738640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:14.739996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:14.740917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:14.742522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:14.742522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:14.742522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:14.742522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 411/818] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:14.742522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.755859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.757304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.773007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:14.773570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:14.774694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:14.775574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:14.775574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:14.775574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:14.775574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 408/819] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:14.775574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.779033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:14.864879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aee10-3429-4255-8800-d3370e30f474 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.889205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc718-f60d-419e-a642-c10fa8a69848 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:14.905281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.905918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.906229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.906504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.907155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:14.907452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.908848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.919322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 412/820] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:14.919322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:14.935952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:14.936997 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:14.937264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:14.937544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:14.938517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] RBAC: Adding query filter params (type=network) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:14.938822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:14.940186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:14.948334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 409/821] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:14.949187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.018627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.027000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.039961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfab2a-6358-4313-946e-0a7274b7ee7d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.056948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1316b-acc8-44a9-a2ea-8cd107aa307e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.085484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.086145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.086427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.086696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.087334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:15.087643 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.089004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.100459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.101205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.101593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.101982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.107686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:15.107836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 413/822] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:15.107944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.108032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.108126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.124866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 410/823] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:15.124866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.242500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960a2f-4e04-493f-844c-f4a06535a87d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.248216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c67b9-41b5-4a23-bfc9-98548ad020eb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.274850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.282379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.282987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.283267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.283541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.284169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:15.284469 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.285048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.285727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.285826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.286164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.286500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.287421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.289204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.290866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 414/824] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:15.296059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.313289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.317143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 411/825] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:15.318195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.462559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30ff5-4727-4f50-b22a-5da5db0c3341 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.500989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb94079-2698-43e3-9cf9-6e42a73f226e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.514193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.515020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.515387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.515761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.531018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.531397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.559064 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.560395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.560837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.561215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.576052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.577720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:15.590939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:15.592085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:15.593149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:15.594560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 412/826] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:15.595434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.642664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:15.667210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:15.668287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:15.669778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 415/827] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:15.670412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.715235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62695c-da40-415f-851d-b91bb926c350 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.750262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.750764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.751091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.751308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.751981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.753324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.757212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.783632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 413/828] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:15.784629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.788684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce0b-1370-40cb-adf1-d7cf259f010b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.839821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.840720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.841669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.842074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.842870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:15.843249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.845094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681177-9ef2-410d-8dde-1be83124b6fc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.864741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 416/829] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:15.864741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149278a3-d984-413c-996e-03f54b019eaa None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.864741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149278a3-d984-413c-996e-03f54b019eaa None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.864741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149278a3-d984-413c-996e-03f54b019eaa None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.864741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 417/830] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:15.866978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149278a3-d984-413c-996e-03f54b019eaa None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:15.898232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.907858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d451bf-08f6-4097-a568-41de51c4f1d4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:15.947007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:15.947704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.948046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.948960 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.949097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:15.949402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:15.950992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403c996-687e-427d-a3d3-ba1bac5d2911 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:15.965237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 414/831] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:15.966953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.967427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.967881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.987058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:15.988348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:15.999279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149278a3-d984-413c-996e-03f54b019eaa None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.037688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.048313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.049408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.050027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.050368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.051413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:16.052170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.054244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.065986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 415/832] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:16.065986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.071976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 418/833] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:15 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:16.159842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.178079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727e4c7-e3ee-4819-8f0b-3bab72cfed6c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.225848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.226575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.226857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.227137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/99bd31cf5ff24090be9f73fa32514be5/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.244103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=99bd31cf5ff24090be9f73fa32514be5, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.245538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.260612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 416/834] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:16 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/99bd31cf5ff24090be9f73fa32514be5/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:16.370916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.483720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbceb1-c33b-4cbd-810e-334dfc929348 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.518571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.519257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.519536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.519805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.531717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:16.536578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:16.537657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:16.538764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 419/835] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:16.544526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.651917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7386c2-6b99-4abd-a045-19dfd4a36f73 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.694596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.694596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.694596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.694981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.695775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:16.696180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.697624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.707237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.707582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 417/836] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:16.713943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.776278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.824392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01947f-7e20-48b5-b6e3-e14d8244b16f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.861871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.862548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.862831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.863104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.874248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.875697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:16.891527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:16.892525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:16.893420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:16.893420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:16.893420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:16.893420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 420/837] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:16.900003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:17.014077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6150-0e03-438e-82dd-ce88755530f6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.042288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.042891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.043171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.043442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.044627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:17.044930 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.046295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.058534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 418/838] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:17.063848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:17.171911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e916d-0cfe-4cc9-8914-fb20359a3b96 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.179877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:17.209646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.211070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.211819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.212591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.221429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.223173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:17.235951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:17.236937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:31:17.237867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:17.240441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 421/839] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:17.246004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:17.305687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:17.352754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0053d-955e-47f8-b020-ba2589f58199 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.390146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.390810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.391087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.391357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.392184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:17.392493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.393908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.412725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 419/840] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 15:31:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:17.417986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:17.525211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb578b-3459-41d2-a080-402b685dcb49 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.564620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.565469 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.565900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.566343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.601718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:17.638176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.639632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c06e3-e54b-4782-96c2-b9982cd5758d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.743176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 422/841] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:17.748603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:17.772366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73cdb-7d78-401c-b26d-3cbac34895fa None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.772652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73cdb-7d78-401c-b26d-3cbac34895fa None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.773091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73cdb-7d78-401c-b26d-3cbac34895fa None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.776066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 423/842] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:17.780715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.780999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.781280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.801455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:17.802776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:17.877275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1e56-59c7-4ead-9aa5-18a4eff0f451 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.893465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:17.899032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:17.903042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 424/843] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:17.928514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.929207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.929486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.929760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.940677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.942145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:17.958386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:17.960560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:17.962699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:17.962699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:17.962699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:17.962699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 420/844] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:17.965493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.070935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4b883-5ea2-47b4-b1f3-67aaccd5add4 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.109025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.109636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.109912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.110212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.110917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:18.111223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.112644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73c76-4750-4ee1-9b0c-0fd1d38d5b75 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.124883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 425/845] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.130518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.200528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0403c-2994-4a54-b459-9cd3842880b8 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.201216 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0403c-2994-4a54-b459-9cd3842880b8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.201700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0403c-2994-4a54-b459-9cd3842880b8 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.203495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 426/846] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:18.204416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0403c-2994-4a54-b459-9cd3842880b8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.238310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa655-357d-4435-b4fa-53f2bd45383d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.269676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:18.275784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.276498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.276783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.277069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.284133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.285557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-90aa3120-092b-4db5-9891-8cfcdf9d1dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:18.297165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:18.298209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:18.299087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:18.303135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 421/847] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:18.304419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.304712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.304987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.321396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0403c-2994-4a54-b459-9cd3842880b8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.323543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:18.324734 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:18.345786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:18.359210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.359853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.360219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.360503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.361082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.362659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:18.372929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:18.374398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.375456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 427/848] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:18.376228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.404928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 422/849] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:18.405710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.479847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c290-4164-4d24-8411-ede67618d480 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.502140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:18.515754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5361d-3dd0-4f46-8b3d-c9d47a6735af None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.517511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.518165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.518444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.518716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.519412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:18.519726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.521148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264e2f-5a30-4b21-a8c8-bd43e30ebd72 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.535150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 428/850] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.536515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2541-0c60-4dc5-9f84-18aced691555 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.536907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2541-0c60-4dc5-9f84-18aced691555 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.537286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2541-0c60-4dc5-9f84-18aced691555 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.538782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 429/851] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:18.543599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd2541-0c60-4dc5-9f84-18aced691555 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.557849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.558461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.558743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.559020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.559686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:18.559990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.561338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b2d2-a4ac-4167-b802-d4f9e0a13fb3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.566211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 423/852] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.568086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.568821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.569237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.590221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:18.592040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:18.607446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:18.652822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd2541-0c60-4dc5-9f84-18aced691555 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.670085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 424/853] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:18.670085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.692187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.692896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.693177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.693457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.694365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=356ba9813a5740a2b6495debb9c1e5bf) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:18.694542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.695958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.702568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 430/854] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/role_assignments?user.id=356ba9813a5740a2b6495debb9c1e5bf&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.711786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.784480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:18.793736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0701c6-a9ea-4101-b002-62cd1e20533e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.836113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.836832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.837187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.837534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.838284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:18.838928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.840085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.848394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 425/855] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.873036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120f2e-4c06-4b83-8e55-3763cd4840c9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:18.918118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:18.918918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.919195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.919476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.920080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:18.921540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:18.931792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:18.932791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:18.933682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:18.936043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 431/856] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:18.939515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.939696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:18.957807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.083167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aa634-f622-4fa3-ae78-c47345af39ab None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.084143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e6ad5-3d65-41cd-aff9-7ebe0d764e09 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.093860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.125817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.126732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.127215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.127612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.128695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:19.129281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.130975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.135923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.136775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.137191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.138179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.141760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 432/857] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:19.143009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.151006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:19.158099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:19.159233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:31:19.160246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:19.163315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 426/858] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:31:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:19.168879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.266646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.274965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71018b-8635-43a9-8c1f-9ea8b322faa2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.295750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be985d1-7b5d-4c39-805d-fb5f0ed9d9e9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.332457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.333074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.333356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.333632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.334299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:19.334607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.335987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.339634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.340492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.341528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.342055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.342927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:19.343431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.345019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.350531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 433/859] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:19.356045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 427/860] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:19.364649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.403161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.482925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467fec-3585-4b81-880e-b44e73407f23 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.521831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.522432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.522710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.522981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.534744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.536169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:19.550904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:19.551872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:19.553113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:19.553113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:19.553113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:19.553113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 434/861] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:19.557926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.664978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfec48-7278-4552-b082-1ecca12a5ca8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.701029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.701647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.701925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.702231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.702879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:19.703181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.704531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.706996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.718112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 428/862] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:19.723306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.819218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.834945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa00eb-8100-47e1-aa1a-09c4ef08e7f4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.874801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.875823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.876333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.876825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.885656 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.887547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:19.901274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:19.902322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:19.903779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:19.906583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 435/863] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:19.915114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.028626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44199-926f-44c0-962e-1b2680cd9289 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:20.063360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:20.063965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.064239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.064504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.065229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:20.065530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:20.066966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:20.084809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 429/864] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:20.090222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.194739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67571c4-5179-41f1-8792-80d90c2d2a73 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:20.235076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:20.235692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.235967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.236234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.256090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:20.313920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:20.315761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:20.430158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 436/865] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:20.435942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.493339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:20.548461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615878-5903-46df-b047-a2767b9ed967 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:20.583353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:20.583983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.584259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.584526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.595799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:20.597265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:20.612931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:20.613910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:20.615466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:20.615466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:20.615466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:20.615466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 430/866] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:20.619683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.672212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:20.726981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414721c2-0beb-4b5e-bad7-8a3107400d02 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:20.766217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:20.767214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.767738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.768232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.769094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:20.769622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:20.771205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54702a2e-7ee9-49cd-ab2b-0c1f0e787e0b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:20.784191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 437/867] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:20.792078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.830155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd4d5-a14b-4c4b-b100-4e71c9abf813 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.830744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd4d5-a14b-4c4b-b100-4e71c9abf813 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.831021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecd4d5-a14b-4c4b-b100-4e71c9abf813 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.832609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 438/868] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:20.837560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843b9d-0e3e-456b-8141-adfb711e4929 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.838040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843b9d-0e3e-456b-8141-adfb711e4929 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.838320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843b9d-0e3e-456b-8141-adfb711e4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.861069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3a843b9d-0e3e-456b-8141-adfb711e4929 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:20.862703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3a843b9d-0e3e-456b-8141-adfb711e4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:20.904593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef125f-390b-49d5-ba6c-7f8c666efe70 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:20.917038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:20.954662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:20.955219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.955503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.955777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.961508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 439/869] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:20.962757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:20.963470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36c2ab-c47d-4ffa-a736-d33142168e4f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.963931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36c2ab-c47d-4ffa-a736-d33142168e4f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.964355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36c2ab-c47d-4ffa-a736-d33142168e4f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.964482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:20.966631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 440/870] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:20.971828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:20.972274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:20.972697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:20.982440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:20.983553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:20.984651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:20.985879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 431/871] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:20.991180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:20.996942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:20.998834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:21.038591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:21.094374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 441/872] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:21.109106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d9609-dfb1-41d2-9758-b15f7c839e51 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.144312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.145219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.145671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.146158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.147115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:21.147607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.149292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.163862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 432/873] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:21.169370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.245043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.274883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:21.279694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b78e3-3479-40fe-83fb-32f06598bfec None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.314107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.314827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.315040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.315260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.315977 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=99bd31cf5ff24090be9f73fa32514be5) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:21.316281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.317703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f57c72-1458-4c78-9ace-90912eab94a0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.330399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 442/874] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:21 2022] GET /identity/v3/role_assignments?user.id=99bd31cf5ff24090be9f73fa32514be5&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:21.367343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5873-09db-4430-9e35-269e2091d431 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.367687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5873-09db-4430-9e35-269e2091d431 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.367905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5873-09db-4430-9e35-269e2091d431 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.369489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 443/875] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:21.372983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5fe7-ec59-4bbe-8749-808c738515a2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.377205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.377533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.377765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.402081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:21.404089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:21.415860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.416489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.416771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.417047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.417736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.419797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.437647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 433/876] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:21 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:21.438900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.442859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:21.520410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 444/877] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:21.567842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:21.588832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d461386-dca5-4c22-8656-6603307a8d89 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.626722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.627373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.627659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.627939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.628537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.629895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:21.640332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:21.641350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:21.642856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 434/878] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:21.647461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.767444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e3a52-a6c4-464a-98c5-b4bedb4656d6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.795990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.806538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.807158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.807898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.808178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.809224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:21.810116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.811789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.818676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 445/879] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:21.823979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:21.850260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:21.909323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4bd8-70a0-429e-bd3d-928dca92d328 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.934851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336fb6-29bb-4b9f-b2ce-7f15e81afa70 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:21.944312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.945578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.946129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.946601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.947459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.949027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e3cf7-6bce-4b40-a0bd-230bbf3b0320 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:21.973720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 435/880] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:21 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:21.995083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:21.995722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.996005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.996336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.997506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:21.997811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:21.999342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39433d-00d0-4c67-bbae-befa350960bd None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.005495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 446/881] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:23.468415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc0b-192d-4c8f-b6a4-acb805db2738 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:23.468981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc0b-192d-4c8f-b6a4-acb805db2738 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:23.468981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc0b-192d-4c8f-b6a4-acb805db2738 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:23.470738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 436/882] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:23.476412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:23.476869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:23.476961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:23.497301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:23.498537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:23.522769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956eb-ff8c-40f9-9ef3-7da160057aab None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:23.523390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956eb-ff8c-40f9-9ef3-7da160057aab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:23.523897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956eb-ff8c-40f9-9ef3-7da160057aab None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:23.525678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 437/883] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:23.531451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:23.532013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:23.532504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:23.551122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:23.552699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:23.563014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:23.589502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 447/884] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:23.633371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 438/885] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:23.867740 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:23.882742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:23.916746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:23.983523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6c5c-80b4-4e7a-b44c-24dcaf03a9ff None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.023179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.023814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.024096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.024367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.024961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.026367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.028911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1407aa-7ed5-4a5e-b0b4-6461fc7225d5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-3f7b174d-1705-4599-a1b2-7bfa851b72dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:24.035840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:24.036779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.037593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 448/886] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:24.038934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc4d4-8040-466d-ae85-26d889067513 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.038934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc4d4-8040-466d-ae85-26d889067513 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.038934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc4d4-8040-466d-ae85-26d889067513 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.042001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 449/887] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:24.042001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c7cc-2dc5-4ae9-8b53-336fcaf3b1bc None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.042001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c7cc-2dc5-4ae9-8b53-336fcaf3b1bc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.042001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c7cc-2dc5-4ae9-8b53-336fcaf3b1bc None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.043098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 450/888] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:24.043892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c7cc-2dc5-4ae9-8b53-336fcaf3b1bc None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.067243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.067877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.068159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.068433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.077504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.081184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-ce75ac50-9bf1-4af6-8e5e-f962673ad989 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:24.087313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:24.088501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:24.089357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 439/889] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:24.090486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d373-c7a1-4865-8a22-f8e9eead646a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.091341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d373-c7a1-4865-8a22-f8e9eead646a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.091616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236d373-c7a1-4865-8a22-f8e9eead646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.110764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7236d373-c7a1-4865-8a22-f8e9eead646a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:24.111972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7236d373-c7a1-4865-8a22-f8e9eead646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:24.134010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.160956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c7cc-2dc5-4ae9-8b53-336fcaf3b1bc None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.178441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 440/890] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:24.179680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.179963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.180233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.197142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:24.198353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:24.199218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.200331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.200609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.200891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.201517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:24.201823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.203219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.212459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 451/891] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.212459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.271983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 441/892] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:24.273060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.336697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.339313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efeab3-58e9-41a0-a054-8742ee831c91 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.383164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bc15b-cd33-4d2c-b383-b00f3933989b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.387261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.388543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.388918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.389290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.390087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:24.390492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.391965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.406011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 452/893] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.408505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.414270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.431342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.431971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.432259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.432498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.433129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:24.433432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.435351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.445644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 442/894] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.446646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.529248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0bd5-46d9-4421-ad35-18ea84f34bf3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.556701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df3c1-cbd7-4f01-869f-f46d477241c8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.568560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.569197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.569472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.569741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.580246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.580581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.582294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.591905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.592516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.592800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.593085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.593788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] RBAC: Adding query filter params (interface=public, service_id=6fd0dc3ce0344b4cb21f77d5b12fda4a, region_id=RegionOne) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:24.594132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.595475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:24.597992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:24.598969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:24.599824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:24.599824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:24.599824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.599824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 453/895] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:24.600374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.600581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 443/896] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/endpoints?service_id=6fd0dc3ce0344b4cb21f77d5b12fda4a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.601349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.663546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.699510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca4e1-a4f0-47c5-a7ac-a7b8ea618e5f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.709365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999334ec-3d69-4064-b889-a638c0649091 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.734523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.735127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.735406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.735677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.736321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.737661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.743880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.744514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.744795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.745078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.745703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.747054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.751865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 444/897] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:24 2022] POST /identity/v3/services => generated 241 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:24.752674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:24.756808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:24.758057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:24.759074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 454/898] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:24.759874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.815220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.881280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ed96-8710-4566-9600-ab2bd19115ef None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.884321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7be7-4e86-4ccf-8305-904c4ecf424d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:24.902549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:24.928525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.929051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.929332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.929790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.930440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.931845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.932281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:24.934661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.934661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.934661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.934984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:24.935059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:24.936605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:24.939818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 455/899] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:31:24.940596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:24.957537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 445/900] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.961305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.068823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fec6-7a45-4559-bf26-9e83ed7d964b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.082838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff0cb8-ae40-4be5-aedb-86eb70a374a9 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.085615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.111780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.112708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.113200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.113669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.114473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:25.114787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.116209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.121320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 456/901] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:25.123588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.124294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.124580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.124855 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.127667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.133741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.135452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:25.150951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:25.153364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:25.154940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:25.157455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 446/902] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:25.163242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.186416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.252244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eeeb5-4ffe-472c-9fb6-4c6c63bd448e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.295932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0329f7-98d0-44b0-a932-468e1de619bd None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.296239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.296667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.296957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.297239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.297892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:25.298250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.303296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.316992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 457/903] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:25.317599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.348475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.349412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.349874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.350369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.351303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:25.351783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.353385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.378247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 447/904] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:25.379428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.404594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.448441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268496c4-82a6-4dc9-80c2-e6bb87f63729 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.482321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.486963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.487925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.488406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.488871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.489740 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] RBAC: Adding query filter params (interface=public, service_id=dad19baadfee416e83716d5b6fc43053, region_id=RegionOne) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:25.490324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.491864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.498068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 458/905] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/endpoints?service_id=dad19baadfee416e83716d5b6fc43053&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:25.502720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ae3a-ac78-415a-bdde-5f47feab3a63 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.505054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.550308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.550932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.551210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.551482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.620683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8c4e-ed6a-4db4-b601-a5bc8dc2ed4a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.655682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.658531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.678766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.679422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.679704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.680027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.680891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.682026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.692059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.702074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 459/906] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:31:25.786498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 448/907] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:25.792614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.842497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.910088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992afb6-c808-4ecc-9893-4717a609586f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.946695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.947361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.947644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.947919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.961016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.963788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:25.985485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:25.986566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:25.987440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:25.987440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:25.987440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:25.988069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 460/908] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:25.994249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:26.106932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff99b4-cf7c-47ac-b55e-3750373b5615 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:26.132051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:26.144726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:26.145353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.145635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.145906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.146615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:26.146921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:26.148314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:26.162168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 449/909] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:26.167350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:26.269280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:26.281047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e0f4a-1cc5-407e-9578-279d1530d835 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:26.324071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:26.324718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.325575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.326090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.333234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:26.334853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:26.350592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:26.352649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:26.355185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 461/910] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:26.359217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:26.472059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f246-963a-420a-a3a9-9b2e06e0587f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:26.507275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:26.507884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.508167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.508442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.509136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:26.509447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:26.510895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72fd37-7614-4fad-8ef1-f3a1f3af6ad0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:26.524108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 450/911] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:26.530600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:26.645455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08346c-feaa-4cf7-94b9-767e379bebc1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:26.681492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] RBAC: Adding query filter params (role.id=420b72d404d24bbfbaddc556ceab212a, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=99bd31cf5ff24090be9f73fa32514be5) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:26.685325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19d69-98a3-454c-b976-e962b96ed43d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:26.691452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 462/912] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:26 2022] GET /identity/v3/role_assignments?user.id=99bd31cf5ff24090be9f73fa32514be5&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=420b72d404d24bbfbaddc556ceab212a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:26.802899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6eb8-7405-4865-981f-a71d4c24ba8e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.803875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6eb8-7405-4865-981f-a71d4c24ba8e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.804354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6eb8-7405-4865-981f-a71d4c24ba8e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.806332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 451/913] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:26.812256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb49f-9ffb-40a3-8a36-70a3a35601af None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:26.812545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb49f-9ffb-40a3-8a36-70a3a35601af None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:26.812824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb49f-9ffb-40a3-8a36-70a3a35601af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:26.832512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4becb49f-9ffb-40a3-8a36-70a3a35601af None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:26.834113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4becb49f-9ffb-40a3-8a36-70a3a35601af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:26.845363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:26.909799 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 463/914] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:27.095220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b8cc-70fa-464b-aa91-9f978f580858 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.095899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b8cc-70fa-464b-aa91-9f978f580858 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.096455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b8cc-70fa-464b-aa91-9f978f580858 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.098304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 452/915] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:27.104011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.104300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.104826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.123483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:27.125045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:27.175527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b8cc-70fa-464b-aa91-9f978f580858 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.197756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 464/916] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:27.222740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.283424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b8cc-70fa-464b-aa91-9f978f580858 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.322157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.322803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.323083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.323355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.323946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.326163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:27.335330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:27.336364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:27.337243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 453/917] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:27.344802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.423141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.449654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1869-aff2-435f-8227-7d9194f74ed2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.485024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.485638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.485918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.486223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.486849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:27.487151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.488507 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.493679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 465/918] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:27.503050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.513016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.617906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792368-1069-4348-a2df-bb8407202ef1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.621257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0193-f492-4987-af5c-38a9dbf64d42 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.628881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.661369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.662680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.663143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.663597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.664394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.665980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.673540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.673540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.673540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.673540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.673925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:27.673925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.674207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.679898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 454/919] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:27.684492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:27.685454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:31:27.686313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:27.688832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.696152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 466/920] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:27.698949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.702757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.803553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33231d-1d12-49b7-abe1-9a867412d6ac None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.807970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d51dc-b5ab-4250-b4dd-5fb37f7f8911 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.844477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.845088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.845363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.845631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.846318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.846458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] RBAC: Adding query filter params (interface=public, service_id=bc627f6f4ed545b09ff891dd8594df3d, region_id=RegionOne) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:27.846666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.846893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.847182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.847455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.851598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.851775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:27.851775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.851775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f96cf-f388-466d-9983-4e0ec88f0b97 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.862440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 467/921] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:27.862440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35863-2779-400d-84c1-dd6e53e759f4 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.862440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35863-2779-400d-84c1-dd6e53e759f4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.862440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35863-2779-400d-84c1-dd6e53e759f4 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.862909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 455/922] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/endpoints?service_id=bc627f6f4ed545b09ff891dd8594df3d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:27.863958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.867081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 468/923] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:27.867081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35863-2779-400d-84c1-dd6e53e759f4 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.901705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.954446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.976754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54403-d512-4116-884e-be2423dfb508 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.995929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35863-2779-400d-84c1-dd6e53e759f4 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.014315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.015046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.015226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.015483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.016118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:28.016424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.017784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c333d-dac4-4a0f-9aab-4f25d74d7121 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.027450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 456/924] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:28.027450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.027450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.027450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.041395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.042151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.042501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.042863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.044245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.044740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:28.045611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.045926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:28.062001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 469/925] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:31:28.062001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:28.149880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 457/926] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:28.189838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6fe95-83f0-450c-a364-a7033603dd6f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.221682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:28.227128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.227763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.228050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.228327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.229269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.230693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b6ff-139c-4d2d-bf5c-4bc5c9ff147a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.255000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 470/927] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:28.458908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:28.489411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:28.567009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa83d21-3fb4-46f6-8706-a5e2afbd4daf None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.614276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.615064 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.615334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.615608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.616202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.617625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-88dd9f87-a9ab-4171-a68b-9aa24cdddf8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:28.627536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:28.628526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:28.629417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 458/928] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 15:31:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:28.633984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67f96-ff96-4760-87b5-af64ab6dd899 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.633984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67f96-ff96-4760-87b5-af64ab6dd899 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.633984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67f96-ff96-4760-87b5-af64ab6dd899 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.637174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 471/929] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:28.638031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67f96-ff96-4760-87b5-af64ab6dd899 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:28.638528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.638813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.639081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.661688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:28.663242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:28.766457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 459/930] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:28.772063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67f96-ff96-4760-87b5-af64ab6dd899 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.808804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.809444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.809724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.810014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.810665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:28.810956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.812318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.817585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 472/931] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:28.823276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:28.843069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:28.926703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48eeb6-931e-4b70-bedd-173ccbeca8ec None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.962504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.963122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.963406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.963693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.964316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:28.964625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.966050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.971435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 460/932] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:28.977035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.035135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:29.051397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.089591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30b72-321a-4ce6-bb2c-b9f335846a7a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.126051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.127136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.127626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.128103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.129025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:29.130635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:29.140251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:29.157430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 473/933] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:29.169867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a909f7-3c2d-45df-bba1-8d7d78208cc3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.220560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.221693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.222267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.222759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.236624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:29.242351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:29.243359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:29.244269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:29.247959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 461/934] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:29.257770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.380952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4abb-3233-4525-89dc-ec88b1cc2d4d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.388852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:29.419134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.419950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.420335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.420714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.421520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:29.421933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:29.423500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:29.433540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 474/935] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:29.440352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.546074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d482d-799d-406f-9ce5-f3b5309d90eb None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.581518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.582431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.582856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.583295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.590227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:29.594844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:29.596135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:29.612788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:29.614388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:29.615421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:29.615421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:29.615421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:29.615603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 462/936] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:29.623081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.729459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbb4f-b676-4d3a-b446-fedac739418b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.766794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.767413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.767695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.767969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.768615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:29.768919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:29.770319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:29.783956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 475/937] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:29.789543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.894614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0424e7-1fa1-4cea-ba99-7125d7f0fe1b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:29.930028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:29.930676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:29.930959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:29.931237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:29.939387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:29.940759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-09b97f0f-0049-4e6b-abfe-ddc786cbb71a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:29.953154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:29.954177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:29.955128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 463/938] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:29.960501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:29.998342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.064149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a53a5-0379-4a1f-9479-49f21fea4201 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.081808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682632-a80b-4d56-8700-9d65d259f7bb None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.082145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682632-a80b-4d56-8700-9d65d259f7bb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.082382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682632-a80b-4d56-8700-9d65d259f7bb None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.084280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 464/939] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:30.093944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89623-ba12-4f17-8a07-2bbd7348a620 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.094384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89623-ba12-4f17-8a07-2bbd7348a620 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.094758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b89623-ba12-4f17-8a07-2bbd7348a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.108176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.109026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.109457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.109945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.110844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:30.111299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.112870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.119073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-33b89623-ba12-4f17-8a07-2bbd7348a620 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:30.120724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-33b89623-ba12-4f17-8a07-2bbd7348a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:30.132704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 476/940] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:30.139099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.194421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.206059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 465/941] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:30.231022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.248094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c9c7-9577-4347-bcea-751c8cadabf7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.280721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b53d9e-2224-4382-9dcd-51649b4c338a None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.281060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b53d9e-2224-4382-9dcd-51649b4c338a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.281301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b53d9e-2224-4382-9dcd-51649b4c338a None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.284059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.284231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 466/942] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:30.284703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.284983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.285257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.288317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.288600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.288869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.300705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.302242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.312972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:30.314481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:30.319076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:30.320002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:30.320880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:30.320880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:30.320880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:30.320880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 477/943] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:30.326857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.396661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 467/944] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:30.444551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1267-a750-4a3d-a886-2ee64f615552 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.481522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.482422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.482851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.483301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.484089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:30.484561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.486091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.493757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.494736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.500635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 478/945] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:30.506722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.641772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be664b-4bec-4d8b-9a6b-5a49f109e143 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.651143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b578d9b-5409-4045-b8df-fa2df560bba6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.655246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.683868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.684772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.685056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.685329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.685916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.687393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.692408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.692743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.693030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.693309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:30.696783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:30.697737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:30.698620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.701568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.703478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.703731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 468/946] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:30.704026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:30.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:30.717906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 479/947] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:30.719501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.788349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.814529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140128c-ca6b-4350-8be9-7d3a60aab9c0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.842257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb387d-62aa-43f0-bacf-56e27d9c4fe4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.851226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.851841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.852122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.852416 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.853066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.854806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.857513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING keystone.server.flask.common [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 15:31:30.876626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.sql.core [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:31:30.876626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 15:31:30.876626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [parameters: {'id': '0a192a402a2a4193b80bf973d5077712', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 15:31:30.876626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81790) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:31:30.879182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.879892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.880189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.880465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.881102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:30.881409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.882817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a192a402a2a4193b80bf973d5077712.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a192a402a2a4193b80bf973d5077712. Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:31:30.883432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result.read() Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 15:31:30.884232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application yield resource Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise self.value Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application session.commit() Sep 01 15:31:30.885230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:31:30.886796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:31:30.888203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application result.read() Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:31:30.888976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [parameters: {'id': '0a192a402a2a4193b80bf973d5077712', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.889845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:30.891970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a192a402a2a4193b80bf973d5077712. Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 469/948] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Sep 1 15:31:30 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:30.894759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.900598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 480/949] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:30.901795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.930571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.011700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4c89-0cbd-4f0f-9061-375d32b3ef65 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.020924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724edf-71fc-43b1-91cd-1d56e6997078 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.045044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.047141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.047883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.048356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.048687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.049460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:31.049840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.051582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.057348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.058186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.058650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.059642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.066783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.073133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 470/950] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:31.073316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.073399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:31.086064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:31.086999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:31.087898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 481/951] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:31.088490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.179459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.191956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f44e8-0574-46ca-825e-a9a13ea13152 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.216821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff71ae-b706-4f90-9e18-62f60f77e780 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.230698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.231691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.231978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.232251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.232892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:31.233209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.234694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.244741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 471/952] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:31.244741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.258290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.258956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.259230 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.259502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/99bd31cf5ff24090be9f73fa32514be5/roles/420b72d404d24bbfbaddc556ceab212a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.261632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=99bd31cf5ff24090be9f73fa32514be5, role_id=420b72d404d24bbfbaddc556ceab212a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.263767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.276707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 482/953] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:31 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/99bd31cf5ff24090be9f73fa32514be5/roles/420b72d404d24bbfbaddc556ceab212a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:31.277505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.325917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.373519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608f03b-2927-4800-b9ed-bbd1c740cdd2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.398379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811e081-4704-4235-a143-742bc4b33f06 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.412020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.412998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.413277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.413558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.414278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:31.414580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.416022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeb664-d251-4d88-8864-39dc56e2b658 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.436134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 472/954] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:31.437597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fd9d-6bb6-43e4-89e5-f45804fbbe6d None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.437887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fd9d-6bb6-43e4-89e5-f45804fbbe6d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.438206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fd9d-6bb6-43e4-89e5-f45804fbbe6d None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.439683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 473/955] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:31.440626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.441346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.441759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.442243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.443034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.444605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.445283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.445521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.446005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.467150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:31.468509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:31.471700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 483/956] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:31.486406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.566378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 474/957] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:31.844411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.948610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.953819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b1b9-437b-4d37-8145-755e7cbfe413 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.991503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.992307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.992691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.993073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.993766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.995290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:32.005057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:32.006407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:32.007478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:32.013987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 484/958] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:32.016234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:32.122290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8a02d-6959-4139-885b-b2372eee1409 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:32.161257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:32.161866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:32.162203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:32.162476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:32.163113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:32.163410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:32.164931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215035-26a8-409b-8aee-aa8d030517fa None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:32.170505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 475/959] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:32.176071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:32.281545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fb1-d419-42af-a9d6-8f07884da05f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:32.316628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:32.317582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:32.318146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:32.318627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:32.319455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:32.319984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:32.321597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca81cf-2efa-49a9-afeb-a56f0b17f313 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:32.327540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 485/960] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:33.274978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70dcc-21c9-4be6-80d0-4b668b4ff6ff None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.276042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70dcc-21c9-4be6-80d0-4b668b4ff6ff None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.276533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70dcc-21c9-4be6-80d0-4b668b4ff6ff None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.278433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 476/961] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:33.283967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b67a2-349d-46e5-a766-365dfc5ecc27 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.284825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b67a2-349d-46e5-a766-365dfc5ecc27 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.285307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b67a2-349d-46e5-a766-365dfc5ecc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.304569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9a8b67a2-349d-46e5-a766-365dfc5ecc27 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:33.306190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9a8b67a2-349d-46e5-a766-365dfc5ecc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:33.329142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.379039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 486/962] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:33.449351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03336-4b1c-4470-8baa-785f3bac7bc5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.449742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03336-4b1c-4470-8baa-785f3bac7bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.450471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03336-4b1c-4470-8baa-785f3bac7bc5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.451949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 477/963] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:33.457281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663593aa-06ca-49ed-bc4e-25efcedd20b5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.457574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663593aa-06ca-49ed-bc4e-25efcedd20b5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.457850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663593aa-06ca-49ed-bc4e-25efcedd20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.476299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-663593aa-06ca-49ed-bc4e-25efcedd20b5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:33.477480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-663593aa-06ca-49ed-bc4e-25efcedd20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:33.546241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 487/964] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:33.547885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ee10-bc60-449e-b6da-8c769bb9b505 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.548384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ee10-bc60-449e-b6da-8c769bb9b505 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.548881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ee10-bc60-449e-b6da-8c769bb9b505 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.550718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 478/965] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:33.556103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.556393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.556795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.574640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:33.575875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:33.646692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 488/966] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:33.680993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58ee10-bc60-449e-b6da-8c769bb9b505 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.687161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.798547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58ee10-bc60-449e-b6da-8c769bb9b505 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:33.828702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.838991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:33.839963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.841205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.842076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.847976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.856053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:33.861311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:33.862309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:33.863157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:33.865771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 479/967] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:33.874088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.942632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b056fd-5665-4c2a-9d28-2bc152bd69d3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:33.959588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.983193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:33.983906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.984195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.984520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.985206 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:33.986666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:33.989201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING keystone.server.flask.common [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 15:31:34.003572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.sql.core [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:31:34.003572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 15:31:34.003572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [parameters: {'user_id': 'f3014092e4584233844ead47a6c3fc93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 15:31:34.003572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81791) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:31:34.010697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260927-b78b-4b68-95aa-19342e402af6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application result.read() Sep 01 15:31:34.020871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:31:34.021801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application yield resource Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise self.value Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application session.commit() Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:31:34.023070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:31:34.023962 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:31:34.024819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application result.read() Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:31:34.025677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f3014092e4584233844ead47a6c3fc93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:34.028329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 15:31:34.029408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 489/968] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 15:31:33 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:34.031232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.061759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.062407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.062692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.062969 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.063642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.063946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.065313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.073484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 480/969] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:34.078379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.121313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.144433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1c1c-0225-4ac1-8052-3b1e0b68e9d3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.181151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.182131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.182563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.182839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.183424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.184597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705523a-9b39-4466-babf-3b39249f1095 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.185056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:34.194843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:34.195876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:34.196716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.201235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 490/970] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:34.201937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.215025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.225541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.226351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.226784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.227573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.236898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.238451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:34.250779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:34.251968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:34.252943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 481/971] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:34.253560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.316626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c9b5-3030-4bd8-806c-8251904354d0 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.350422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.351045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.351321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.351829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.360727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26bd6-27e8-4760-aaf7-f9d0b7fb9aaa None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.362647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.364077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.365790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:34.379627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:34.380736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:34.382030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:34.382030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:34.382030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:34.382030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 491/972] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:34.382030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.397063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.397700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.398017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.398291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.398914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.399214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.400549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b5f87-8147-44e8-93c8-15aaec1a85e6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.405104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 482/973] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.406476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa7ed-addb-4693-8155-c924368fc5e1 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.406758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa7ed-addb-4693-8155-c924368fc5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.407028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa7ed-addb-4693-8155-c924368fc5e1 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.408233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 483/974] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:34.408913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa7ed-addb-4693-8155-c924368fc5e1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.461293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.486342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1efef-726b-483f-99db-8e9bf48ebbf2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.513651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa7ed-addb-4693-8155-c924368fc5e1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.520253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.520857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.521135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.521405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.522123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.522426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.523828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.547451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.548050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.548330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.548602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.549239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.549539 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.550902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7fc4e-2c04-4298-9917-39dec9d5deca None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.561587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 492/975] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.562513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.566014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 484/976] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.566014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.566014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.566014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.584055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:34.585091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:34.643024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.666011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 485/977] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:34.666011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.707365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.724883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c618-7acd-4828-ae63-490a0177738a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.775661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.776716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.777259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.777551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.778259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.778569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.780073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.785678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 493/978] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.792335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.795730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4250a5-1ec8-48f2-b290-3b2f8d0cd284 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.855287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.856446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.856789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.857051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.864893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.866353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:34.878652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:34.879625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:31:34.880758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:34.884399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 486/979] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:34.885643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.915017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2852b2-fd57-48cc-9a70-5c0ee65065d8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.935185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.956681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.957461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.957746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.958224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.959025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] RBAC: Adding query filter params (interface=admin, service_id=bc627f6f4ed545b09ff891dd8594df3d, region_id=RegionOne) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:34.959334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.960987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.966561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 494/980] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/endpoints?service_id=bc627f6f4ed545b09ff891dd8594df3d&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:34.967322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.990599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.994090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ea13-470e-4e7a-919c-77a398a403d4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.028798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.029402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.029678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.029951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.030713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:35.031012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.032418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.049084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 487/981] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:35.049886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:35.067891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c474a6-8c36-49e3-bdee-b73cd06f1bae None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.103088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.103698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.104253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.104528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.105208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.107175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.122930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 495/982] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:34 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:35.123875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:35.161883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84319-47f6-45b8-abdb-5e876cff4aa0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.179182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:35.213803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.214456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.214732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.214998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.215667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.217445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.234007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 488/983] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:35 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:31:35.269247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e49e0-bd03-4f44-9e13-2711b665fe04 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.310754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.311390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.311681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.311960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.387384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.388781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.431662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:35.494309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 496/984] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:35.500886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:35.520905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:35.609246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c6a-4241-4320-ad1d-b0855474c75f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.643627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.644189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.644470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.644748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.655343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.656780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:35.673449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:35.674777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:35.675699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:35.675699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:35.675699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:35.678233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 489/985] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:35.679592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:35.782313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0607-93a2-4086-83a7-312b977e3f82 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.817005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.817616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.817901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.818208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.818852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:35.819161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.820522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:35.828899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:35.833934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 497/986] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:35.839054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:35.911880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:35.943729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad40b84-e0d5-4ffe-8f24-ce43c15479b4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:35.978685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:35.979712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:35.980079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:35.980358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:35.987243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:35.988682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:36.000246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:36.001496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:36.002765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:36.006045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 490/987] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:36.007691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:36.114549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab1f44-c863-4a84-a8c2-7cd6ea489faa None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:36.149628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:36.150275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.150560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.150837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.151537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:36.151849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:36.153939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227231d-c768-483b-a7b0-f97e09d79a5e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:36.169493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 498/988] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:36.173591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:36.278645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c7e1-f44c-426e-8e4e-26f1a88d75e7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:36.306568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:36.314843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:36.315525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.315813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.316112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.316844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] RBAC: Adding query filter params (role.id=420b72d404d24bbfbaddc556ceab212a, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=99bd31cf5ff24090be9f73fa32514be5) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:36.317158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:36.318673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39439-5168-402b-846f-4187766efdd5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:36.330060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 491/989] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/role_assignments?user.id=99bd31cf5ff24090be9f73fa32514be5&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=420b72d404d24bbfbaddc556ceab212a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:37.069898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748754e4-46ff-4db2-9932-33dc787b010a None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.070486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748754e4-46ff-4db2-9932-33dc787b010a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.070486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748754e4-46ff-4db2-9932-33dc787b010a None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.072072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 499/990] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:37.078640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.079271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.079545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.099915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:37.101245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:37.147584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9816-7e4d-4628-9876-68535349b616 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.147904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9816-7e4d-4628-9876-68535349b616 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.148134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9816-7e4d-4628-9876-68535349b616 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.149584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 500/991] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:37.155051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.155342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.155620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.173623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 492/992] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:37.178731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:37.180277 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:37.238038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.250848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 501/993] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:37.444157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.523711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.553655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbec67b-967b-4778-91c8-5ee7cc057b28 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.583347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.597911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.598675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.598876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.599173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.599763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.601105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:37.611260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:37.612308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:37.613149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:37.617385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 493/994] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:37.618277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.649199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2473462-777c-4b2b-9470-1ca6258f3b18 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.701035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.701631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.701937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.702249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.702841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.704242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:37.713395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:37.714433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:37.715908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 502/995] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:37.728773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.741706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cfe5-f21b-4050-a14c-e05063b790d2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.780952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.781603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.781886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.782190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.782829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:37.783136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.784494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.789905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 494/996] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:37.790481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.795348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.841006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a78d-bb39-4d6b-9d12-be0ae6db5669 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.857862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.886932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.888104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.888387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.888664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.889305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:37.889612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.891052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.901692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 503/997] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:37.903129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.912235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508e195-7dcf-4f44-8597-d557beb7d8e2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.948716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.949339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.950279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.950558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.951260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:37.951511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.952877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.963051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 495/998] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:37.963940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:38.023053 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f33cd-6c62-485b-9de0-a65d0801329b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.044251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:38.063085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.063713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.063980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.064270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.064886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:38.065195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:38.066606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:38.071394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348881e7-6165-4f8c-a38c-e244c5c97630 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.072176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 504/999] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:38.078363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:38.097410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:38.119950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.120667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.121021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.121386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.122225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] RBAC: Adding query filter params (interface=public, service_id=c605b630222348648403c9609bb3af52, region_id=RegionOne) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:38.122608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:38.124041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:38.129744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 496/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/endpoints?service_id=c605b630222348648403c9609bb3af52&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:38.134913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:38.199283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d577-49b6-4d86-8f8f-4f50c96ac65d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.240334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5417d-e86f-48d3-b760-8c023f0ea499 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.242101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.242823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.243127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.243407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.244152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:38.245795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0309fc7-15e2-4d03-b5d4-8eb0b60c467c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:38.265358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 505/1001] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:38.289177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868403-8c35-4e97-bba5-f12ab445ae26 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.289533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868403-8c35-4e97-bba5-f12ab445ae26 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.289817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868403-8c35-4e97-bba5-f12ab445ae26 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.294022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 506/1002] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:38.297894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.298836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.299036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.299134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.299378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.299534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.300024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.300766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:38.302229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:38.312387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 497/1003] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:38 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:31:38.325683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:38.326999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:38.373481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:38.415712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 507/1004] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:38.686661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:38.731965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:38.797238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec39cd-7df4-4792-b8fc-4197a75597d5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.831424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.832130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.832419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.832697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.833282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:38.834662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:38.844107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:38.845095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:38.846978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 498/1005] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 15:31:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:38.851034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:38.960430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79a39-6f0d-463f-8d9b-a0272d03a5eb None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:38.997047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:38.997668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:38.997951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:38.998246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:38.998882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] RBAC: Adding query filter params (name=image) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:38.999189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:39.000555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801201e8-4c03-4544-8fef-39bff2921c53 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:39.010015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 508/1006] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:39.011246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:39.118976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dcbf4-caae-4d31-89b7-c6836c8486d6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:39.121335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:39.154913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:39.155515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:39.155792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:39.156061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:39.156678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] RBAC: Adding query filter params (type=image) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:39.156980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:39.158363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821d1b0-68bc-4352-addc-e541b4754a51 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:39.170254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 499/1007] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:40.248349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aff8d-036d-41a7-a653-141f5383ac95 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.248888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aff8d-036d-41a7-a653-141f5383ac95 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.248888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aff8d-036d-41a7-a653-141f5383ac95 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.250519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 509/1008] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:40.255838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.256293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.256389 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.275125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:40.275941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2068d-4a20-40eb-b1ac-6f23b536fc45 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.276232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2068d-4a20-40eb-b1ac-6f23b536fc45 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.276331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:40.276505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2068d-4a20-40eb-b1ac-6f23b536fc45 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.277857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 510/1009] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:40.284178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.284831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.284831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.302841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:40.304007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:40.335842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:40.347915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 500/1010] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:40.380923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 511/1011] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:40.620154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.650294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.734080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:40.739563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336a23e-23e1-42c9-9d89-732ca35dd226 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.781594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.782261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.782537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.782918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.783934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:40.784388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021acc-71f6-47a9-908f-ea1acf84a528 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.785378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.787486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 501/1012] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:40.793013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.819816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.820401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.820690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.820965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.821552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:40.822946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:40.831785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:40.832781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:40.834101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 512/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:40.838586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.870929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:40.913593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe630f-61e4-44df-a713-c6c924f73df8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.950049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.950717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.951009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.951280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.951966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:40.953398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.956718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846dec1-4633-4803-a540-8f8be2eb2f08 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.994044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 502/1014] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:40 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:40.997813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.998529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.998810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.999083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.999733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:41.000037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:41.001595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1806a-d7c1-459f-b2b1-3d964ec5a398 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:41.010003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 513/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:41.014176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:41.036715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:41.112867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fece1-2baa-4c1c-94d4-fa3dfe9d0e5c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:41.113149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fece1-2baa-4c1c-94d4-fa3dfe9d0e5c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:41.113427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fece1-2baa-4c1c-94d4-fa3dfe9d0e5c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:41.115081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 514/1016] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:41.120519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:41.120809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:41.121152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:41.140474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:41.141697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:41.144669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cef8-12a1-48af-94ec-48abebbf4639 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:41.184633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:41.185922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:41.186230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:41.186502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:41.187140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:41.187441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:41.188806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:41.194448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 503/1017] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 15:31:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:41.200594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:41.225949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 515/1018] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:41.296464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:41.317012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328db80-f144-4983-b6c7-b9bb080e15c4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:41.350560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:41.351166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:41.351609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:41.351886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:41.352553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:41.353903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69b4ae-1174-49cf-b62e-ee4227a25afc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:41.386115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 504/1019] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:41.504284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:41.531049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:41.612659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dd0db-d6b4-464a-85d9-f4b71d27b3bd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:41.654687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:41.655223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:41.655496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:41.655759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:41.656416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:41.657790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f2a4-6e25-4dcb-9ae5-df6be897b823 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:41.677298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 516/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:41 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:42.995291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b85ad-55e9-4c5c-b404-ccf1c7b2f24c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:42.995787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b85ad-55e9-4c5c-b404-ccf1c7b2f24c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:42.995787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b85ad-55e9-4c5c-b404-ccf1c7b2f24c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:42.997865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 505/1021] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:43.002914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0ed7-37c9-4d58-a0b9-8564d43c46a2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.003322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0ed7-37c9-4d58-a0b9-8564d43c46a2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.003485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0ed7-37c9-4d58-a0b9-8564d43c46a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.022128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-22ef0ed7-37c9-4d58-a0b9-8564d43c46a2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:43.023319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-22ef0ed7-37c9-4d58-a0b9-8564d43c46a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:43.102255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 517/1022] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:43.367720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b85ad-55e9-4c5c-b404-ccf1c7b2f24c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:43.452526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597440-8336-4d4c-b946-36fb2af67991 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.452853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597440-8336-4d4c-b946-36fb2af67991 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.453094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597440-8336-4d4c-b946-36fb2af67991 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.455754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 518/1023] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:43.459754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3cf5-150e-4580-b4e3-697bb2367c4b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.460043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3cf5-150e-4580-b4e3-697bb2367c4b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.460326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3cf5-150e-4580-b4e3-697bb2367c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.472923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:43.481168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-cd4c3cf5-150e-4580-b4e3-697bb2367c4b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:43.482959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cd4c3cf5-150e-4580-b4e3-697bb2367c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:43.483438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b85ad-55e9-4c5c-b404-ccf1c7b2f24c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:43.520145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:43.520771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.521048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.521318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.522472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:43.523885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:43.525489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 506/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:43.531091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:43.539877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:43.567247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 519/1025] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:43.633627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365983cf-49b6-4e53-82c5-dd2fbad26b54 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.634077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365983cf-49b6-4e53-82c5-dd2fbad26b54 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.634311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365983cf-49b6-4e53-82c5-dd2fbad26b54 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.635665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 520/1026] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:43.639851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbca4-4510-40da-af73-9a0c5ced8128 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:43.640744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.641033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.641319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.659452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:43.660650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:43.679388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:43.680146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.680428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.680706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:43.681361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:43.686077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:43.706664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 507/1027] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:43 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:43.749135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 521/1028] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:43.842907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:43.916776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:43.961507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe2513-aed3-4ece-91c0-b06c4e9620e7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:43.994795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:43.995422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:43.995944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:43.995944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.007891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:44.013508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:44.014603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:44.015444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:44.016080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.016522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 508/1029] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:44.021548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.088510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.132058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931529d9-daaf-492b-98d8-ceccb962645a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.132260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa088f-f98c-480c-a33b-c0f43b3fbdec None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.156355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.168660 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.169196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.169480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.169752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.170467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.170778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.172129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.175140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.175774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.176054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.176324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] PATH_INFO: `/v3/services/image` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.177328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.178414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.180153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 509/1030] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:44.186034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:44.188286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:44.189259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:44.190152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:44.194588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 522/1031] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:44.195217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.295427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbba4f-c2ab-4b81-b0b3-c2ff325f788d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.301681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687a7c-f210-4e9d-b041-3e8a0ade1d67 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.332823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.334828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.335767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.336192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.336643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.339777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.340976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.341258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.341529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.342188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.342495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.343872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.348963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 523/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:44.351863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.353450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.355115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:44.371913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:44.373120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:44.374017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:44.374017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:44.374017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:44.374017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 510/1033] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:44.378926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.417209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.472049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95822e3-d111-426c-a0ea-f285eea832d8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.486326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d84b-07e1-47ef-aa9d-670a7dcac129 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.508549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.509161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.509696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.509696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.510360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] RBAC: Adding query filter params (type=image) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.510663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.512046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.517878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 524/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:44.523690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.524708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.525313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.525592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.525860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.526532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.526830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.528807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.541569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 511/1035] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:44.547952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.589242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.636742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0d871-02d4-419f-99a0-4051ecb1064f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.645348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.651445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776bff5-3be0-4db0-8f34-0e0c95d46c88 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.680051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.680668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.680948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.681225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.681927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] RBAC: Adding query filter params (interface=public, service_id=91d6405c82a14f329db98949c52e7691, region_id=RegionOne) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.682265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.684587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.689899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 525/1036] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/endpoints?service_id=91d6405c82a14f329db98949c52e7691&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:44.693553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.694246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.694516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.694789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.695364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.704918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.706561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:44.718393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:44.719351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:44.720828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 512/1037] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:44.725642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:44.807881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de536-1fa8-4fee-90ae-bf16ee1df8e9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.832205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:44.843140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d06b-6a60-4c7f-a603-3a8cf4d3cd5a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:44.844720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.845335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.845621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.845892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.846534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.847904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.854732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 526/1038] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:31:44.891113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:44.891765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.892046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.892321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.893106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:44.893414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:44.894947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:44.915642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 513/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:44.922021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.035069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9e85f-bf5e-4d39-8a28-5764074a90e5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.078477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.079107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.079391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.079667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.138999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.153865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.155341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.267826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 527/1040] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:45.269086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.284859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.370255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af318f1-43fe-40a7-9e08-4841fff8d3f4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.410181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.410961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.411375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.411655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.422025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.423480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:45.439712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:45.440696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:45.441589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:45.441589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:45.441589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:45.441589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 514/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:45.447583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.535565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.552272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc61ad1-2aac-4ff9-b35b-9c6c43c4231d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.586975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.587586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.587865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.588137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.588779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:45.589082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.590492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923d7c4-08e2-4525-988f-7dde001deb87 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.602026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 528/1042] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:45.608235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.676916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.716583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55216aa4-72ab-4275-ab2b-2cacd65d12c2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.752473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.753112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.753397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.753674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.755515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc6-cece-484a-b50a-8b4ce7da8fbd None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.756154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc6-cece-484a-b50a-8b4ce7da8fbd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.756436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92edc6-cece-484a-b50a-8b4ce7da8fbd None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.758415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 529/1043] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:45.761003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.762631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.763312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.763608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.763874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:45.774047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:45.775016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:45.775928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 515/1044] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:45.780954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.786327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:45.787528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:45.857671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 530/1045] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:45.891692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725077a3-21e2-4daf-a866-fcaf43d40a2f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.918869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.928948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.929496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.929777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.930099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.930793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:45.931107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.932527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.950169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 516/1046] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:45.951433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:46.031428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:46.056007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538148a3-4a70-4fd8-b905-f23d818897ab None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:46.092365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:46.092968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.093247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.093516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.094273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] RBAC: Adding query filter params (role.id=420b72d404d24bbfbaddc556ceab212a, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:46.094583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:46.096004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:46.110051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 531/1047] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=420b72d404d24bbfbaddc556ceab212a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:46.126784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:46.237723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2279e-24dc-4e02-8fd9-1a3cbc2ef2d8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:46.274310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:46.274938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.275213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.275487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.285745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:46.290624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:46.291548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:46.292439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:46.294052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 517/1048] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:46.297843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:46.400419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ca15-ce2b-462b-b335-8a9143ae9a4e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:46.441792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:46.442437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.442722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.442994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.444039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:46.444349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:46.445727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:46.458141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 532/1049] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:46.462397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:46.512959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:46.569826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fadd-7eef-42ec-a60a-c25f983dccb3 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:46.603685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:46.604566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.604846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.605116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] PATH_INFO: `/v3/users/bf2a0c57cfea4268a4ad936b5dc23048` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.619665 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] RBAC: Authorizing `identity:get_user(user_id=bf2a0c57cfea4268a4ad936b5dc23048)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:46.621121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865876f7-843d-4ed1-9ebe-5f621dec5f8e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:46.623450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 518/1050] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:46 2022] GET /identity/v3/users/bf2a0c57cfea4268a4ad936b5dc23048 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:46.629156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:46.632132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:46.742502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec42e42-b05a-4249-a5ba-092a3883fa64 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:46.777251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:46.778323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.778602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.778873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.807579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829c7d-9135-4e22-a0cd-ad6c6eb93962 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.807898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829c7d-9135-4e22-a0cd-ad6c6eb93962 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.808130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829c7d-9135-4e22-a0cd-ad6c6eb93962 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.809529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 519/1051] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:46.814867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:46.815144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:46.815413 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:46.833126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:46.834353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:46.848741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:46.850212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:46.852036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:46.910730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 520/1052] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:46.965986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 533/1053] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:46.971867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.006228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.076532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2788a-14df-4ae2-9fbf-8b0e8a3e1376 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.112941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.113579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.113858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.114155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.115290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.116706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.118548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 521/1054] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:46 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:47.124380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.184925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.233828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f305e8-5b21-48a6-a996-57b62d7689f2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.235427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.273236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.273951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.274254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.274528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.275284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=ae362c36662e48fcabc65c3813785ae6, user.id=bf2a0c57cfea4268a4ad936b5dc23048) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:47.275599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.277076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.294002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 534/1055] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:47 2022] GET /identity/v3/role_assignments?user.id=bf2a0c57cfea4268a4ad936b5dc23048&scope.project.id=ae362c36662e48fcabc65c3813785ae6&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:47.301858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcc572-78ba-4b03-81c3-ee06f97d4e83 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.304072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.342991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.343552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.343835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.344112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.344717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.346139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:47.356326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:47.357420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:47.358301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:47.362432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 522/1056] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 15:31:47 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:47.363833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.473655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbc3d1-c882-4fed-91f2-3dd14efb8514 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.508324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.508939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.509218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.509489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.510141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:47.510451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.511834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.522062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 535/1057] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:47.523248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.625869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a2f27-e17e-49ce-8335-471cdaae9ea2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.661940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.662635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.662923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.663198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.663831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:47.664134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.665484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cba1e-b8a7-4428-b09a-a38ee4593ec9 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.678219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 523/1058] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:47.679168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.716339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.788210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75115da-e648-4251-95a0-7a6c67e0cbc5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.822976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.823613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.823895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.824166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.825385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.826775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9e24-317a-4351-9d73-3903b4f1c13f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.856634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 536/1059] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:48.002880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e289e-db9a-48cd-b804-627e13c41f67 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:48.003088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e289e-db9a-48cd-b804-627e13c41f67 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:48.003380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e289e-db9a-48cd-b804-627e13c41f67 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:48.004723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 524/1060] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:48.010013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:48.010309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:48.010583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:48.029064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:48.030286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:48.111326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 537/1061] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:48.377614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e289e-db9a-48cd-b804-627e13c41f67 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:48.409618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:48.483718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e289e-db9a-48cd-b804-627e13c41f67 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:48.519695 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:48.520328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:48.520605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:48.520875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:48.531904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:48.536819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:48.537721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:48.538983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:48.542057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 525/1062] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:48.545032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:48.560255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:48.653468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29597960-6dea-4ee7-82fb-7a20c91bbbc9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:48.690564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:48.691224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:48.691505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:48.691775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:48.692442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:48.692744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:48.694124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:48.703436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 538/1063] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:48.709040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:48.804378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:48.816280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818904e9-f303-414a-a8e8-af553b0b4e16 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:48.855117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:48.856311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:48.856582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:48.856881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:48.867328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:48.868746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:48.884501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:48.885513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:48.886460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:48.886460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:48.886460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:48.886460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 526/1064] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:48.892134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:48.974061 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.001174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058ba2-ce77-4c72-90f4-3d1ffca72809 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.035405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.036016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.036295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.036598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.037212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:49.037515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.038939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f53a22-3a0d-4ebc-92a9-baa6507f47c9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.056515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 539/1065] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:49.058434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.160653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcc965-e88e-44c2-ab29-568ea1625407 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.193629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a62e0-e01e-4b74-b5e6-cb98d5f89b5c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.193954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a62e0-e01e-4b74-b5e6-cb98d5f89b5c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.194218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a62e0-e01e-4b74-b5e6-cb98d5f89b5c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.195193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.195704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 540/1066] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:49.195891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.196158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.196574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.200375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.200657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.200970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.204817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.206262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.219632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:49.220822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:49.221898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:49.222859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:49.223805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:49.225780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 527/1067] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:49.233131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.236128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.298266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 541/1068] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:49.349192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e8e4-094b-4d32-b786-fdf35bf94b26 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.385362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.386661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.387623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.387915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.388669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:49.388984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.390441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.412992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 528/1069] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:49.414660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.478777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.518594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65dea-594f-414a-93c6-86bb44ffe9a9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.552777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.553404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.553681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.553953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.564472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.565919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.566400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:49.581954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:49.582963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:49.584165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:49.584165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:49.584165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:49.584165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 542/1070] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:49.588675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.629603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.673015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49bec4-a8ce-4462-86d1-b7cb637fdf4f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.703771 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade35a16-1e1e-4749-9015-08594a349151 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.712015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.712731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.713086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.713364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.723629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:49.724070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:49.728762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:49.730251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:49.732337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:49.736008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 529/1071] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:49.736736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.749058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.749686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.749984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.750267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.751063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:49.751372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.752750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.767008 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 543/1072] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:49.772260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.847936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cb0-59bf-43e8-bc29-4f3c05b353fc None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.868901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:49.876042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a32a-aa86-4d68-b9a3-9d2bc25c915d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:49.883289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.883904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.884184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.884454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.885122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:49.885430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.886843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34eeff-0b99-4bff-bd8d-db39547a59b2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.897168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 530/1073] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:49.898437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95717b-1f8d-4274-aebd-29790f8ea02b None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.898722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95717b-1f8d-4274-aebd-29790f8ea02b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.899033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95717b-1f8d-4274-aebd-29790f8ea02b None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.900186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 531/1074] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:49.903323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95717b-1f8d-4274-aebd-29790f8ea02b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:49.915193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:49.915832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.916113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.916387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.923656 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:49.925087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-57557c02-0f62-444e-ac08-9cadbae9b032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:49.936253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:49.937320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:49.938283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 544/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:49.938802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.939091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.939371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.957843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:49.959093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:49.988547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.009150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95717b-1f8d-4274-aebd-29790f8ea02b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.026747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 545/1076] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:50.028096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.045033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.045687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.045939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.046244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] PATH_INFO: `/v3/users/bf2a0c57cfea4268a4ad936b5dc23048` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.047377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] RBAC: Authorizing `identity:get_user(user_id=bf2a0c57cfea4268a4ad936b5dc23048)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.048830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.054887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 532/1077] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:49 2022] GET /identity/v3/users/bf2a0c57cfea4268a4ad936b5dc23048 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:50.056164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.116671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.140365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140e51d-6f1f-4805-9ec3-1d5f8f9ace86 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.171407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313928-28be-415e-bb36-06a36821e23c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.174657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.175460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.175896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.176169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.176865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:50.177171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.178624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.194905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 546/1078] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:50.196929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.210458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.211089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.211372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.211644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.212772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.214215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.216550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 533/1079] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:50.222140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.227855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.315832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5c0f5-11bf-40f5-a8f2-a957c63df067 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.326982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fdff8-ae2f-4607-bb09-78a971c21791 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.344464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.350340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.351006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.351295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.351574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/420b72d404d24bbfbaddc556ceab212a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.353738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=ba7d3b76b6b746f1b1c2585feef177b0, role_id=420b72d404d24bbfbaddc556ceab212a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.355464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.362467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.363607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.363915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.364220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6/users/bf2a0c57cfea4268a4ad936b5dc23048/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.366185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae362c36662e48fcabc65c3813785ae6, user_id=bf2a0c57cfea4268a4ad936b5dc23048, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.367939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.369282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 547/1080] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:50 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/ba7d3b76b6b746f1b1c2585feef177b0/roles/420b72d404d24bbfbaddc556ceab212a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:31:50.370278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.389302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 534/1081] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:50 2022] PUT /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6/users/bf2a0c57cfea4268a4ad936b5dc23048/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:31:50.487191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.507945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c4709-6873-4b02-aa26-6bcab100b92a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.548941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.549558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.549953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.550145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.622993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.624330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.714116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.732404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 548/1082] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:50.738472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.841782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541175-8bc7-4561-a362-545ee6415e41 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.877255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.877807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.878115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.878387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.889928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.891420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-68661725-c281-47e3-86ea-f97adf9bb87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:50.908001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:50.909168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:50.910154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:50.910154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:50.910154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:50.914380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 535/1083] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:50.915705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:51.019982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d14b69-1606-4244-8cdf-87f3e0cd8d98 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:51.055392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:51.056002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:51.056280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:51.056550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:51.057293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:51.057591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:51.059029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1840a5-1508-45d4-963a-4a9dfbf99224 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:51.070522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 549/1084] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:52.292726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f68-d779-4b9b-a620-39677978b45c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.293856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f68-d779-4b9b-a620-39677978b45c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.293995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3f68-d779-4b9b-a620-39677978b45c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.295270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 536/1085] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:52.300629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.301059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.301191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.319816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:52.321004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:52.335516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56974-6d9c-47e7-ae3e-221e119de748 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.335797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56974-6d9c-47e7-ae3e-221e119de748 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.336074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56974-6d9c-47e7-ae3e-221e119de748 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.337432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 537/1086] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:52.342402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.342681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.342954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.361279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:52.362513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:52.366648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:52.386979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:52.393264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 550/1087] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:52.430296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 538/1088] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:52.660094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:52.706714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:52.761881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254c63b-ed3a-4e15-af6a-ad650b5c94a2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:52.798535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:52.799166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.799483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.799760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.809143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5514cc-79ab-4ac7-b291-81b71032fad1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:52.809709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:52.814640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:52.815767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:52.816598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 551/1089] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:52.821583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:52.843187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:52.843817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.844092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.844361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.853990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:52.856430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:52.859793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:52.860748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:52.861616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 539/1090] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:52.866902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:52.895622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:52.927919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db441d7a-bb35-4562-8269-109864e88823 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:52.962980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:52.963591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:52.963871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:52.964147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:52.964832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:52.965158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:52.966553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:52.974546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 552/1091] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:52.976473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360547b8-d8d0-4133-9d33-1f0580992702 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:52.980863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.010989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.011597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.012494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.012776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.013444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:53.013750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.015141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.023173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 540/1092] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.029050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.076057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.080372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901d7c-961e-4e83-a820-e8b2b57c1548 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.113250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.128195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.128826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.129107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.129391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.132617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d43bf-bc6e-418c-b45b-097a3ed91410 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.140272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.141726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:53.156069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:53.157000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:53.157883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:53.157883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:53.157883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:53.157883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 553/1093] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:53.162998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.169693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.170352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.170636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.170911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] PATH_INFO: `/v3/users/bf2a0c57cfea4268a4ad936b5dc23048` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.172057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] RBAC: Authorizing `identity:get_user(user_id=bf2a0c57cfea4268a4ad936b5dc23048)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.173476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.175099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 541/1094] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/users/bf2a0c57cfea4268a4ad936b5dc23048 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.180910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.270322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59b00d-9e7e-4440-bddc-36fd76a311fc None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.289233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74bd0-c1b4-44b8-ad9a-fbbb01d9f3bf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.306351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.306972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.307250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.307522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.308172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:53.308477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.310714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.322732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 554/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.327214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.328007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.328208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.328337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.328439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.340950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.350075 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.401986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.403591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.434549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff2bf-aa0f-4ce7-9ddc-3cc96446a8d4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.470994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.471629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.471906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.472174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.482373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.483819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:53.495606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:53.498138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:31:53.499419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 555/1096] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:53.503191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.508072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 542/1097] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:31:53.514217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.569299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.576349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.611805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001a8ae-ac9e-4c27-b6e9-0c78ca764a29 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.621511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00324-63a0-4b73-9d09-ca0c60ac69af None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.645466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.646112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.646414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.646735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.647424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:53.647725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.649140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.655453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.656082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.656365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.656644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.657763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.659202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.660849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 543/1098] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.667098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.667495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 556/1099] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.674000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.779926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee43c-e218-4899-8910-0d2897f6857d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.786067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570514d-9781-4e22-9742-d5450b2b5f49 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.798899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.820104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.820317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.820724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.821007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.821348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.822299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=ae362c36662e48fcabc65c3813785ae6, user.id=bf2a0c57cfea4268a4ad936b5dc23048) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:53.822731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.824345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.828647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.829261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.829546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.829822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.830531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 544/1100] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/role_assignments?user.id=bf2a0c57cfea4268a4ad936b5dc23048&scope.project.id=ae362c36662e48fcabc65c3813785ae6&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.922882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.924322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.031656 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 557/1101] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:31:54.037421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.138918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbea-1cd1-4ab3-ab99-728337df5303 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.172615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.173242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.173522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.173791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.184322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.185752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:54.200342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:54.201404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:54.202407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:54.202407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:54.202407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:54.202407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 545/1102] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:54.207084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.235107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:54.309930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2493ee-68a5-4751-ae76-c6c8dd42c1f3 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.343811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.344145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.344419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.344673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.345311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:54.345605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.347146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.358549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 558/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:54.364306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.398824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:54.463709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf277a4-8679-4a05-87b8-0865a30f41a2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.496557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.497180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.497467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.497735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.504380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.505812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:54.518263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:54.519200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:31:54.520091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 546/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:54.525160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.617690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:54.630390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5fce-63c2-43e5-b5a6-e3fee50ea27d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.662635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.663178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.663454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.663731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.664419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:54.664725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.666188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a646d-ba44-4715-8245-3c88cab0411c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.678474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 559/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:54.685301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.779986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:54.787070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f34b5-5126-49f1-ab53-cbb1c7b23e86 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.821238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.822277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.822277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.822515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.823123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] RBAC: Adding query filter params (role.id=420b72d404d24bbfbaddc556ceab212a, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=ba7d3b76b6b746f1b1c2585feef177b0) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:54.823429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.825361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5633b9-ef16-4bdc-b894-2989f2309cad None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.834228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 547/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:54 2022] GET /identity/v3/role_assignments?user.id=ba7d3b76b6b746f1b1c2585feef177b0&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=420b72d404d24bbfbaddc556ceab212a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:55.795226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72263c-17a3-4ac2-b597-3af34d7f8a9f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:55.804887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72263c-17a3-4ac2-b597-3af34d7f8a9f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:55.804887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72263c-17a3-4ac2-b597-3af34d7f8a9f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:55.804887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 560/1107] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:55.805178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:55.805178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:55.805178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:55.824161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:55.825357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:55.895743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 548/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:56.166705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72263c-17a3-4ac2-b597-3af34d7f8a9f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.279443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72263c-17a3-4ac2-b597-3af34d7f8a9f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:56.311856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:56.312479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.312761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.313033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.314170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:56.315586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569831-7823-4e7a-982d-3950dedb1222 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:56.317157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 561/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:56.323318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.407117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:56.418924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60a9ec-cdb1-4bad-8bd3-9ad3b40dcef2 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:56.451759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:56.452360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.452641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.452918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.453577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:56.455025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b9fab-2495-4b05-9654-30bb8271e4e6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:56.476198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 549/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:56 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:58.447742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0364-d29e-4c23-92c9-b82fb11eee6a None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:58.448313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0364-d29e-4c23-92c9-b82fb11eee6a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:58.448313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0364-d29e-4c23-92c9-b82fb11eee6a None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:58.449654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 562/1111] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:58.454976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:58.455406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:58.455528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:58.473426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:58.474663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:58.539547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 550/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:58.822341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0364-d29e-4c23-92c9-b82fb11eee6a None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:58.840692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:58.924156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0364-d29e-4c23-92c9-b82fb11eee6a None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:58.957405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:58.958054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:58.958333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:58.958605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] PATH_INFO: `/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:58.959984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] RBAC: Authorizing `identity:get_role(role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:58.961331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:58.962685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 563/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:58 2022] GET /identity/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:58.969193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:59.041242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:59.066983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb390d16-16dc-4dac-a0c4-992560a580ec None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:59.104152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:59.104956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:59.105233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:59.106137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] PATH_INFO: `/v3/users/98f6e379668447c9855d07f8692cd788` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:59.119160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] RBAC: Authorizing `identity:get_user(user_id=98f6e379668447c9855d07f8692cd788)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:59.120586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:59.122297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 551/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:58 2022] GET /identity/v3/users/98f6e379668447c9855d07f8692cd788 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:59.128270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:59.212778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:59.228939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a909-e4a0-49ea-865c-e2ca6cf4fa45 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:59.265660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:59.266302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:59.266585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:59.266859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:59.332730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:59.334185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:59.413697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:59.429667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 564/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:59.435749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:59.533103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8c484-0d23-4c54-aa06-802cb66db489 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:59.561616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:59.567062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:59.567689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:59.567972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:59.569069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:59.569365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:59.570812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6443b6f-5271-4b3b-94f1-22b9158d29d6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:59.572490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 552/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:59 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:59.579241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:59.675990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632021-2eb7-4eee-8499-6eef38391d58 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:59.710400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:59.710986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:59.711267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:59.711540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:59.712253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=ae362c36662e48fcabc65c3813785ae6, user.id=98f6e379668447c9855d07f8692cd788) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:59.712566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:59.713992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bc4fc-c9eb-4ef1-9f3f-b0cd3ad8478a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:59.719263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 565/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:59 2022] GET /identity/v3/role_assignments?user.id=98f6e379668447c9855d07f8692cd788&scope.project.id=ae362c36662e48fcabc65c3813785ae6&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:01.595049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c00d-7a8a-4367-8476-006a916801ab None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:01.595577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c00d-7a8a-4367-8476-006a916801ab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:01.595577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c00d-7a8a-4367-8476-006a916801ab None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:01.596921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 553/1118] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:01.602136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:01.602529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:01.602678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:01.620522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:01.621736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:01.663731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:01.686274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 566/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:01.954782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319c00d-7a8a-4367-8476-006a916801ab None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:02.055574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319c00d-7a8a-4367-8476-006a916801ab None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:02.091154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:02.091789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:02.092079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:02.092355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] PATH_INFO: `/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:02.093992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] RBAC: Authorizing `identity:get_role(role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:02.095483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:02.096850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 554/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:01 2022] GET /identity/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:02.103497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:02.200963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a9eec-b3ea-4489-839f-b77f5a7bfefc None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:02.234037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:02.234648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:02.234878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:02.235148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] PATH_INFO: `/v3/users/98f6e379668447c9855d07f8692cd788` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:02.236246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] RBAC: Authorizing `identity:get_user(user_id=98f6e379668447c9855d07f8692cd788)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:02.237660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:02.239247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 567/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:02 2022] GET /identity/v3/users/98f6e379668447c9855d07f8692cd788 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:02.245013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:02.310323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:02.342489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca1f-cae9-44f4-a3b9-f6efdcdd30c0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:02.375958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:02.376582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:02.376866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:02.377141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:02.378291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:02.379707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897a06-f343-4f5f-adda-db22388638fa None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:02.381326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 555/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:02 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:02.387356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:02.433029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:02.485164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f1a5-5bd2-422d-9b4d-aec473e3397a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:02.520218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:02.520890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:02.521175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:02.521455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6/users/98f6e379668447c9855d07f8692cd788/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:02.523723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] RBAC: Authorizing `identity:create_grant(project_id=ae362c36662e48fcabc65c3813785ae6, user_id=98f6e379668447c9855d07f8692cd788, role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:02.525210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc046-cb83-4a10-97c4-2473c525e70a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:02.538904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 568/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:32:02 2022] PUT /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6/users/98f6e379668447c9855d07f8692cd788/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:32:04.416903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5926-a333-483b-8534-1d6c147262c5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:04.417434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5926-a333-483b-8534-1d6c147262c5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:04.417434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5926-a333-483b-8534-1d6c147262c5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:04.419379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 556/1124] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:04.424525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:04.424917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:04.425072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:04.443320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:04.444490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:04.509477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 569/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:04.774551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f5926-a333-483b-8534-1d6c147262c5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:04.876190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f5926-a333-483b-8534-1d6c147262c5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:04.911760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:04.912396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:04.912679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:04.912956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] PATH_INFO: `/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:04.914380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] RBAC: Authorizing `identity:get_role(role_id=ed69a12a1ec84446b9ed9b5ad25fcdb4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:04.915731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:04.917063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 557/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:04 2022] GET /identity/v3/roles/ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:04.923582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:04.956586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:05.021510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb63cf4-b027-4a3a-9df4-9d03a3a1965f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:05.055242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:05.055871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:05.056154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:05.056436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] PATH_INFO: `/v3/users/98f6e379668447c9855d07f8692cd788` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:05.057558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] RBAC: Authorizing `identity:get_user(user_id=98f6e379668447c9855d07f8692cd788)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:05.059044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:05.060626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 570/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:04 2022] GET /identity/v3/users/98f6e379668447c9855d07f8692cd788 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:05.066643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:05.070370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:05.165666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf47af-8e5c-4161-85b3-e456f83506e4 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:05.197545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:05.198170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:05.198453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:05.198725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:05.266190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:05.267616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:05.271115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:05.367864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 558/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:05.374013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:05.470669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24443b0c-e84b-4c97-9c72-b29fadfdf501 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:05.472943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:05.505081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:05.505712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:05.506020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:05.506300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] PATH_INFO: `/v3/projects/ae362c36662e48fcabc65c3813785ae6` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:05.507419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] RBAC: Authorizing `identity:get_project(project_id=ae362c36662e48fcabc65c3813785ae6)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:05.508855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94203a-4725-4488-be27-c49896c2a603 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:05.510528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 571/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:05 2022] GET /identity/v3/projects/ae362c36662e48fcabc65c3813785ae6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:05.517344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:05.613296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622005-fbc1-4a56-81a9-e6bd9b456aae None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:05.615606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:05.646861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:05.647451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:05.647727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:05.647994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:05.648704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] RBAC: Adding query filter params (role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4, scope.project.id=ae362c36662e48fcabc65c3813785ae6, user.id=98f6e379668447c9855d07f8692cd788) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:05.649007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:05.650431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fb9d3-71cf-47bb-8f2d-a103147ff073 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:05.656019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 559/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:05 2022] GET /identity/v3/role_assignments?user.id=98f6e379668447c9855d07f8692cd788&scope.project.id=ae362c36662e48fcabc65c3813785ae6&role.id=ed69a12a1ec84446b9ed9b5ad25fcdb4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:07.597616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a80f5d-9403-4512-a3fe-16854676bc70 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:07.598337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a80f5d-9403-4512-a3fe-16854676bc70 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:07.598337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a80f5d-9403-4512-a3fe-16854676bc70 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:07.599530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 572/1131] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:07.604995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:07.606018 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:07.606121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:07.624326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:07.625508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:07.688875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 560/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:07.955466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a80f5d-9403-4512-a3fe-16854676bc70 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:08.056508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a80f5d-9403-4512-a3fe-16854676bc70 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:08.091096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:08.091722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:08.092005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:08.092280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:08.093397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:08.094859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497357-fb2a-42ff-8570-248dbc65afc6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:08.096432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 573/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:08.102532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:08.195866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:08.201128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dbd2c-e465-4efc-a15d-24726d28e747 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:08.236232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:08.236752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:08.237029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:08.237299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:08.237951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:08.239393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a5015-7a0d-4cc9-b979-29389fed3a5a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:08.265714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 561/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:32:08 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:32:10.196511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756ee-d56e-4f2a-a7e8-55693ac45e3e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:10.197044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756ee-d56e-4f2a-a7e8-55693ac45e3e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:10.197044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756ee-d56e-4f2a-a7e8-55693ac45e3e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:10.198443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 574/1135] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:10.204238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:10.204628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:10.204781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:10.222497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:10.223666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:10.294151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 562/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:10.569854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc756ee-d56e-4f2a-a7e8-55693ac45e3e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:10.612358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:10.671838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc756ee-d56e-4f2a-a7e8-55693ac45e3e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:10.705828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:10.706492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:10.706777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:10.707052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:10.708166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:10.709591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000c077-09af-4638-b89d-e9fdafb08be2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:10.711199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 575/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:10.717033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:10.796551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:10.815898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9434a8-3cb9-4830-9217-9d730c469349 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:10.851090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:10.851630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:10.851912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:10.852186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:10.852839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:10.854284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48324cb4-c446-4ac6-b465-36cfb0a7254e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:10.876347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 563/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:32:10 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:32:12.826812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5375e-c295-4d9f-8f2c-baf90ecdcc10 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:12.827339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5375e-c295-4d9f-8f2c-baf90ecdcc10 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:12.827339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5375e-c295-4d9f-8f2c-baf90ecdcc10 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:12.828708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 576/1139] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:12.833903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:12.834312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:12.834477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:12.852865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:12.854086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:12.925134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 564/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:13.198105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5375e-c295-4d9f-8f2c-baf90ecdcc10 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:13.298007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5375e-c295-4d9f-8f2c-baf90ecdcc10 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:13.307148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:13.332586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:13.333218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:13.333498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:13.333767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:13.343719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:13.348531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:13.349637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:13.350905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 577/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:13.356613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:13.419501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:13.454583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115b570-e104-4c98-9513-0f91b35f05db None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:13.487830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:13.488434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:13.488716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:13.488990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:13.489654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:13.489986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:13.491338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:13.499788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 565/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:13.505638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:13.604031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249366-be73-4539-b2f6-bd6b260c17f4 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:13.638736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:13.639382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:13.639663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:13.639939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] PATH_INFO: `/v3/users/ef057951f23e4511a3a3864e469cd788` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:13.653349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] RBAC: Authorizing `identity:get_user(user_id=ef057951f23e4511a3a3864e469cd788)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:13.654812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:13.656461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 578/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:13 2022] GET /identity/v3/users/ef057951f23e4511a3a3864e469cd788 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:13.662399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:13.763372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014562a-7ade-4b49-91c2-432ade2bfb88 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:13.788736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:13.797201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:13.797809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:13.798122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:13.798399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:13.865133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:13.866602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:13.965949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 566/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:32:13.971934 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:14.000611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:14.074594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d50a3-ce76-4b0e-9218-6987b5d20728 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:14.115041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:14.115703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:14.115988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:14.116265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] PATH_INFO: `/v3/projects/259af73f37fc4ea38700b257fcba0880` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:14.117950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] RBAC: Authorizing `identity:get_project(project_id=259af73f37fc4ea38700b257fcba0880)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:14.119454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2cfab-ebf6-4436-8e7d-b08e9d86eda5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:14.122657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 579/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:13 2022] GET /identity/v3/projects/259af73f37fc4ea38700b257fcba0880 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:14.129558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:14.158353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:14.238436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2193c-d22a-446c-a1a5-f80bc9b99a05 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:14.271572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:14.272175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:14.272457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:14.272730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:14.273454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=259af73f37fc4ea38700b257fcba0880, user.id=ef057951f23e4511a3a3864e469cd788) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:14.273766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:14.275204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee92f0-3777-44bd-80a7-a82f2af0dfde None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:14.280637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 567/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:14 2022] GET /identity/v3/role_assignments?user.id=ef057951f23e4511a3a3864e469cd788&scope.project.id=259af73f37fc4ea38700b257fcba0880&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:16.171898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b449a-56a2-42cd-ab07-d08b14730a6e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:16.172448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b449a-56a2-42cd-ab07-d08b14730a6e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:16.172448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b449a-56a2-42cd-ab07-d08b14730a6e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:16.173781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 580/1147] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:16.178857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:16.179243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:16.179409 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:16.197229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:16.198440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:16.262569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 568/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:16.530616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b449a-56a2-42cd-ab07-d08b14730a6e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:16.623111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:16.631098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b449a-56a2-42cd-ab07-d08b14730a6e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:16.663756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:16.664378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:16.664658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:16.664930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:16.678627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:16.684066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:16.685157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:16.686237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:16.690114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 581/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:16.691171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:16.715283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:16.791631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1dab-3f89-46c2-b69e-f2ab0cd8de6b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:16.824648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:16.825254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:16.825533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:16.825807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:16.826502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:16.826803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:16.828158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:16.835947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 569/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:16.842385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:16.941158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6427-3ab2-42e6-aca3-5eb19f354de9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:16.975455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:16.976161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:16.976445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:16.976721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] PATH_INFO: `/v3/users/ef057951f23e4511a3a3864e469cd788` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:16.977874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] RBAC: Authorizing `identity:get_user(user_id=ef057951f23e4511a3a3864e469cd788)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:16.979342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:16.981808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 582/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:16 2022] GET /identity/v3/users/ef057951f23e4511a3a3864e469cd788 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:16.987684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:17.068679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:17.084266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5237403-0faa-403e-8007-57d1142c8a82 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:17.117736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:17.118391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:17.118677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:17.118951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] PATH_INFO: `/v3/projects/259af73f37fc4ea38700b257fcba0880` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:17.120055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] RBAC: Authorizing `identity:get_project(project_id=259af73f37fc4ea38700b257fcba0880)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:17.121496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece871b-33dc-4a32-94d8-0acc8c1ca81c None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:17.123159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 570/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:16 2022] GET /identity/v3/projects/259af73f37fc4ea38700b257fcba0880 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:17.129112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:17.154103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:17.233659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed96fb-6ee7-4b00-af8a-cc69d857fcf1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:17.266758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:17.267414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:17.267699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:17.267975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] PATH_INFO: `/v3/projects/259af73f37fc4ea38700b257fcba0880/users/ef057951f23e4511a3a3864e469cd788/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:17.269869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] RBAC: Authorizing `identity:create_grant(project_id=259af73f37fc4ea38700b257fcba0880, user_id=ef057951f23e4511a3a3864e469cd788, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:17.271318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be97807-b7e9-493a-b2cd-afe488c4fd05 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:17.284503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 583/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:32:17 2022] PUT /identity/v3/projects/259af73f37fc4ea38700b257fcba0880/users/ef057951f23e4511a3a3864e469cd788/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:32:19.144365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945018-d8b7-401d-9f96-a2b4fd5b0a60 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:19.144919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945018-d8b7-401d-9f96-a2b4fd5b0a60 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:19.144919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945018-d8b7-401d-9f96-a2b4fd5b0a60 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:19.146251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 571/1154] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:19.151307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:19.151747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:19.152335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:19.171262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:19.172435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:19.238060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 584/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:19.509533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e945018-d8b7-401d-9f96-a2b4fd5b0a60 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:19.608769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e945018-d8b7-401d-9f96-a2b4fd5b0a60 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:19.641183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:19.641804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:19.642123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:19.642392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:19.652722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:19.657573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:19.658672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:32:19.659638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 572/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:19.664818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:19.678877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:19.763447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0326cd-ffae-4d62-9222-00419d196c53 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:19.795716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:19.796309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:19.796587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:19.796860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:19.797517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:19.797817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:19.799197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:19.806940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 585/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:19.813310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:19.829090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:19.912918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbb9c-02f3-4495-aa1a-9bc92caf1b72 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:19.945334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:19.945975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:19.946264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:19.946536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] PATH_INFO: `/v3/users/ef057951f23e4511a3a3864e469cd788` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:19.947646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] RBAC: Authorizing `identity:get_user(user_id=ef057951f23e4511a3a3864e469cd788)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:19.949649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:19.951265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 573/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:19 2022] GET /identity/v3/users/ef057951f23e4511a3a3864e469cd788 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:19.957246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:20.031579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:20.056440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562a6c-da3f-48bc-a0e7-a6adc2691168 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:20.090351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:20.090955 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:20.091236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:20.091509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:20.158722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:20.160164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:20.230324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:20.255837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 586/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:20.262833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:20.341143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:20.360107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d1d5-96f8-436d-af6c-9b4f93ab8017 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:20.392965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:20.393590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:20.393871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:20.394173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] PATH_INFO: `/v3/projects/259af73f37fc4ea38700b257fcba0880` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:20.395293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] RBAC: Authorizing `identity:get_project(project_id=259af73f37fc4ea38700b257fcba0880)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:20.396706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dace5d-d49e-4051-8403-b35a853a7478 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:20.398361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 574/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:20 2022] GET /identity/v3/projects/259af73f37fc4ea38700b257fcba0880 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:20.405161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:20.506639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875b4e3-1428-4409-8dd4-593299015068 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:20.542175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:20.542826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:20.543107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:20.543383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:20.544102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=259af73f37fc4ea38700b257fcba0880, user.id=ef057951f23e4511a3a3864e469cd788) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:20.544412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:20.545836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451195d-3433-4a49-9541-00bad3b99aa3 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:20.551606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 587/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:20 2022] GET /identity/v3/role_assignments?user.id=ef057951f23e4511a3a3864e469cd788&scope.project.id=259af73f37fc4ea38700b257fcba0880&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:22.459816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226159-cb24-4fbe-9ae3-b0d0e535d47f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:22.460355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226159-cb24-4fbe-9ae3-b0d0e535d47f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:22.460355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226159-cb24-4fbe-9ae3-b0d0e535d47f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:22.461681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 575/1162] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:22.466791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:22.467212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:22.467338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:22.486614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:22.487811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:22.517208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:22.554949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 588/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:22.822465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226159-cb24-4fbe-9ae3-b0d0e535d47f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:22.925881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226159-cb24-4fbe-9ae3-b0d0e535d47f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:22.959542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:22.960146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:22.960428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:22.960843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:22.978636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:23.028757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:23.030217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:23.124945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 576/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:23.130738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:23.227152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5f3a0-cc41-4c4a-ace6-0780ab5a80ec None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:23.259731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:23.260354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:23.260633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:23.260904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:23.267857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:23.269279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-917fc630-4585-4eb1-8f19-2eb831fefa42 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:23.281021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:23.282243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:23.283294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 589/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:32:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:23.288070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:23.334786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:23.383703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80f0d-0a9a-4911-b195-959fcda2f6da None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:23.416790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:23.417424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:23.417700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:23.417996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:23.418640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:23.418944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:23.420298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae74767-61fb-44bf-a321-4ece38df237a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:23.427214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 577/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 15:32:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:25.304208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0402e-cf95-490e-b36b-e5c16004f271 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:25.304733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0402e-cf95-490e-b36b-e5c16004f271 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:25.304733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0402e-cf95-490e-b36b-e5c16004f271 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:25.306125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 590/1167] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:25.311373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020814-17fa-47f3-a1f9-0c79d8155dd3 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:25.311795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020814-17fa-47f3-a1f9-0c79d8155dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:25.311933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020814-17fa-47f3-a1f9-0c79d8155dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:25.329693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8d020814-17fa-47f3-a1f9-0c79d8155dd3 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:25.330919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8d020814-17fa-47f3-a1f9-0c79d8155dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:25.395216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 578/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:25.661902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0402e-cf95-490e-b36b-e5c16004f271 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:25.691969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:25.764936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0402e-cf95-490e-b36b-e5c16004f271 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:25.797306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:25.797915 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:25.798228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:25.798503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:25.799163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:25.800525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41c7b-98e8-4e89-bde1-6a8b49ede79f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:25.816565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 591/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Sep 1 15:32:25 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:32:27.725072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337fa3-643d-40d9-9dc7-3d2bbf690c34 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:27.725613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337fa3-643d-40d9-9dc7-3d2bbf690c34 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:27.725613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29337fa3-643d-40d9-9dc7-3d2bbf690c34 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:27.727009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 579/1170] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:27.732271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:27.732698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:27.732804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:27.750636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:27.751828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:27.818458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 592/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:28.095532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29337fa3-643d-40d9-9dc7-3d2bbf690c34 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:28.141371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:28.205013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29337fa3-643d-40d9-9dc7-3d2bbf690c34 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:28.238238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:28.238865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:28.239146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:28.239419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] PATH_INFO: `/v3/domains/6a57527ee9f34e5392c49709a54d6df5` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:28.250132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a57527ee9f34e5392c49709a54d6df5)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:28.251442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1421-d7b3-41ec-ba0c-2e9acfdda20e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:28.253039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 580/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Sep 1 15:32:28 2022] GET /identity/v3/domains/6a57527ee9f34e5392c49709a54d6df5 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:28.258867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:28.277624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:28.355925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184ccbb-d5ed-447e-8b72-cda728e995f5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:28.388630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:28.389227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:28.389502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:28.389770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:28.390439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:28.391852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c893e0-5072-4382-92b9-02c346570abd None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:28.417281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 593/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:32:28 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:32:30.359544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a465bd-5464-4501-be35-b73e360ba835 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:30.360103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a465bd-5464-4501-be35-b73e360ba835 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:30.360103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a465bd-5464-4501-be35-b73e360ba835 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:30.361446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 581/1174] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:30.366551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:30.367001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:30.367102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:30.385432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:30.387229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:30.448232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:30.456815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 594/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:30.724164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a465bd-5464-4501-be35-b73e360ba835 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:30.827562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a465bd-5464-4501-be35-b73e360ba835 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:30.829065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:30.861260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:30.861882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:30.862191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:30.862465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] PATH_INFO: `/v3/domains/6a57527ee9f34e5392c49709a54d6df5` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:30.863574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a57527ee9f34e5392c49709a54d6df5)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:30.865103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e270bca-83ea-481a-a596-12a3e707c0af None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:30.866694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 582/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Sep 1 15:32:30 2022] GET /identity/v3/domains/6a57527ee9f34e5392c49709a54d6df5 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:30.873593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:30.979414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862265c7-a20f-49a1-9590-91d11ed2add1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:31.013280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:31.013886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:31.014197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:31.014472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:31.015131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:31.016555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972708f-f9b8-40dc-8179-9aa812a659d6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:31.036894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 595/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:32:30 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:32:32.984934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675287-306c-4ebd-9535-0a470c420866 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:32.985430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675287-306c-4ebd-9535-0a470c420866 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:32.985430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675287-306c-4ebd-9535-0a470c420866 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:32.986756 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 583/1178] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:32.991974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:32.992362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:32.992537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:33.010478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:33.012150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:33.061856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:33.085553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 596/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:33.356012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9675287-306c-4ebd-9535-0a470c420866 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:33.454372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9675287-306c-4ebd-9535-0a470c420866 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:33.487006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:33.487633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:33.487911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:33.488187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:33.499004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:33.503815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:33.504800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:32:33.505691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 584/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:33.511948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:33.607996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c383bc-5dd8-4329-817c-3348f089361b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:33.640682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:33.641278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:33.641560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:33.641835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:33.642529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:33.642832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:33.644190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:33.651957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 597/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:32:33.657928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:33.688420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:33.756634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48049-cb62-43eb-9c9b-f8b35140031c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:33.791037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:33.791659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:33.791936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:33.792209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] PATH_INFO: `/v3/users/8e8b0174ff6249daa63fb07057f6df7b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:33.805678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b0174ff6249daa63fb07057f6df7b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:33.807121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:33.809318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 585/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:33 2022] GET /identity/v3/users/8e8b0174ff6249daa63fb07057f6df7b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:33.815484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:33.863693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:33.913786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449391b-2dfb-42f9-b27e-81b0439a05ea None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:33.947902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:33.948537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:33.948821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:33.949096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:34.018688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:34.020139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:34.066639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:34.118770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 598/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:34.124853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:34.209284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:34.222398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe403-ac66-40db-b693-c7457646360e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:34.255753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:34.256371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:34.256643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:34.256919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] PATH_INFO: `/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:34.258053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ee5bb664ce434a5e9d9b95a46acc81e0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:34.259469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19ddfe-928d-487a-9a4b-f813f86a46b4 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:34.261109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 586/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:34 2022] GET /identity/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:34.267443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:34.365527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75a81-a2fa-4fa7-af7c-e677b837cb01 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:34.398854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:34.399385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:34.399775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:34.400049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:34.400770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=ee5bb664ce434a5e9d9b95a46acc81e0, user.id=8e8b0174ff6249daa63fb07057f6df7b) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:34.401080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:34.403099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291de6b2-4a3c-45e3-8b7a-60cd827807c1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:34.408517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 599/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:34 2022] GET /identity/v3/role_assignments?user.id=8e8b0174ff6249daa63fb07057f6df7b&scope.project.id=ee5bb664ce434a5e9d9b95a46acc81e0&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:32:36.274636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566715da-2bdf-4ef4-9ffa-3acb89a2f125 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:36.275198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566715da-2bdf-4ef4-9ffa-3acb89a2f125 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:36.275198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566715da-2bdf-4ef4-9ffa-3acb89a2f125 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:36.276464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 587/1186] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:36.281727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:36.282190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:36.282300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:36.299991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:36.301167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:36.308819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:36.366919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 600/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:36.635287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566715da-2bdf-4ef4-9ffa-3acb89a2f125 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:36.733747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566715da-2bdf-4ef4-9ffa-3acb89a2f125 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:36.772455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:36.773091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:36.773375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:36.773651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:36.783857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:36.788661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:36.789765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:32:36.790827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 588/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:36.796319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:36.892616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18d854-4664-4106-b4a9-dc6be862f7a8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:36.927639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:36.928238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:36.928515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:36.928786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:36.929445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:36.929745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:36.931155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:36.939521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 601/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:36.945577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:36.964445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:37.047472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389e97-7e2c-4e15-84f0-040eb703dd10 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:37.079438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:37.080063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:37.080343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:37.080614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] PATH_INFO: `/v3/users/8e8b0174ff6249daa63fb07057f6df7b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:37.081926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b0174ff6249daa63fb07057f6df7b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:37.083803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:37.085370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 589/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:36 2022] GET /identity/v3/users/8e8b0174ff6249daa63fb07057f6df7b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:37.091717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:37.095476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:37.189885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0165-079d-4fb2-9fb0-a64a331450f6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:37.222319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:37.222939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:37.223216 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:37.223486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] PATH_INFO: `/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:37.224583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=ee5bb664ce434a5e9d9b95a46acc81e0)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:37.226007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b33534-c64a-4ccd-951b-e8af4a747dd5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:37.227624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 602/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:37 2022] GET /identity/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:37.234322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:37.315871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:37.331543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad29eb8-a5b8-4705-b600-ebbba6cfcbe6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:37.365008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:37.365661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:37.365941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:37.366243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] PATH_INFO: `/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0/users/8e8b0174ff6249daa63fb07057f6df7b/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:37.368116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee5bb664ce434a5e9d9b95a46acc81e0, user_id=8e8b0174ff6249daa63fb07057f6df7b, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:37.369530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4129280-77f3-477c-adbe-dcd31d7a24c0 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:37.381559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 590/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:32:37 2022] PUT /identity/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0/users/8e8b0174ff6249daa63fb07057f6df7b/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:32:39.282703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c2bc-1ebd-474d-b938-98811e327cf1 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:39.283273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c2bc-1ebd-474d-b938-98811e327cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:39.283273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c2bc-1ebd-474d-b938-98811e327cf1 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:39.284641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 603/1193] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:39.290122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:39.290549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:39.290678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:39.308961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:39.310181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:39.376288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 591/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:39.651244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c2bc-1ebd-474d-b938-98811e327cf1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:39.721746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:39.754338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c2bc-1ebd-474d-b938-98811e327cf1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:39.787548 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:39.788180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:39.788463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:39.788739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:39.799385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:39.804308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:39.805431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:32:39.806365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 604/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:39.812543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:39.884621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:39.909892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf265-5174-4dcc-b2fc-fcdedf76975f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:39.943630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:39.944223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:39.944503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:39.944777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:39.945433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:39.945736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:39.947123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:39.954873 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 592/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:39.960693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:40.060136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43bdda-eab2-4965-b8d8-5b3cdf690f70 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:40.089593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:40.095125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:40.095762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:40.096047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:40.096351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] PATH_INFO: `/v3/users/8e8b0174ff6249daa63fb07057f6df7b` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:40.097438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b0174ff6249daa63fb07057f6df7b)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:40.098900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:40.100480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 605/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 15:32:39 2022] GET /identity/v3/users/8e8b0174ff6249daa63fb07057f6df7b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:40.107279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:40.203471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeabfc-61d2-44a6-82ec-aacba14481b7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:40.236233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:40.236829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:40.237109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:40.237381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:40.240666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:40.304472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:40.305920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:40.401058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 593/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:40.407609 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:40.504050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529121e0-ae3d-4773-a0cc-6f2f4c8ae81f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:40.537545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:40.538193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:40.538478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:40.538754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] PATH_INFO: `/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:40.539865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] RBAC: Authorizing `identity:get_project(project_id=ee5bb664ce434a5e9d9b95a46acc81e0)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:40.541283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf635a0-85d3-4e85-b404-af204c510a64 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:40.543009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 606/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 15:32:40 2022] GET /identity/v3/projects/ee5bb664ce434a5e9d9b95a46acc81e0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:40.549149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:40.584125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:40.648063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21dfc4-d687-42ea-8256-016b13fb0c9a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:40.683038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:40.683634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:40.683910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:40.684179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:40.684895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=ee5bb664ce434a5e9d9b95a46acc81e0, user.id=8e8b0174ff6249daa63fb07057f6df7b) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:40.685197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:40.686700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a793d55-87ea-4eab-aead-91cfb0fe6390 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:40.692381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 594/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:40 2022] GET /identity/v3/role_assignments?user.id=8e8b0174ff6249daa63fb07057f6df7b&scope.project.id=ee5bb664ce434a5e9d9b95a46acc81e0&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:50.533409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=66 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:50.689744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=50 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:36.297756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb903-40c1-4a86-8b72-9f865e5e6d24 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:36.298599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb903-40c1-4a86-8b72-9f865e5e6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:36.298599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb903-40c1-4a86-8b72-9f865e5e6d24 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:36.302006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 607/1201] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:36.306679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:36.306679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:36.306679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:36.326926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:36.328300 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:36.422010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 595/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:36.724486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb903-40c1-4a86-8b72-9f865e5e6d24 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:36.868961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb903-40c1-4a86-8b72-9f865e5e6d24 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:36.926016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:36.927020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:36.927320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:36.927591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:36.943468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:36.944815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:36.965572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:36.966909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:36.967864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:36.967864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:36.967864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:36.967864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 608/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:36.974431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:37.100615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eed16-0be1-4ce3-9114-a8a56f6acbda None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:37.137448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:37.149562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:37.150221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:37.150507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:37.151605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:37.152221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:37.152337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:37.153706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb044f-c6ef-4460-bf55-172fd6a9f2c1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:37.168735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 596/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:37.174861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:37.248186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:37.332899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe545-a5b8-47e6-bb6f-6769cab46dfb None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:37.381356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:37.381982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:37.382275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:37.382544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:37.385600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:37.385600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693508a-ef8b-40e9-b009-efba6a7c9ba8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:37.418044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 609/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 15:33:37 2022] POST /identity/v3/users => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:33:39.632857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20caa32-823f-4ae1-b906-25f607153b56 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:39.633410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20caa32-823f-4ae1-b906-25f607153b56 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:39.633503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20caa32-823f-4ae1-b906-25f607153b56 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:39.635109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 597/1206] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:39.641533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:39.642116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:39.642116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:39.664396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:39.665614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:39.745344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 610/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:40.016816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20caa32-823f-4ae1-b906-25f607153b56 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:40.166235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20caa32-823f-4ae1-b906-25f607153b56 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:40.217844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:40.218619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:40.218906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:40.219219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:40.237316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:40.244294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:40.246289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:40.247145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 598/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:40.253205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:40.298658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:40.366479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14c101-ab6e-4de0-80ab-3e2d0684bfa1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:40.405019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:40.405765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:40.406149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:40.406572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:40.407266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:40.407646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:40.409169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:40.419268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 611/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:40.424934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:40.486722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:40.551225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879a13-f0b0-430f-8f80-f2888d9068d0 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:40.592360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:40.593054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:40.593334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:40.593601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:40.606178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:40.608085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:40.625853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:40.627153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:40.628050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:40.628050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:40.628050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:40.628050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 599/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:40.633132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:40.743512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:40.747166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fd6a-82ce-4dbf-a78d-a963753ef921 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:40.784098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:40.784712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:40.784997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:40.785273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:40.785924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:40.786261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:40.787695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:40.801459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 612/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:40.807761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:40.915194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40cee5-d087-4803-863f-e5b1a71e7cfa None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:40.917587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:40.956078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:40.956767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:40.957050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:40.957344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:40.968334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:40.968334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:40.984967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:40.991200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:40.992395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 600/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:40.993180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:41.121384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699685ba-bdc4-4699-9c3e-0c95986b424a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:41.167217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:41.167789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:41.168074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:41.168354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:41.171880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:41.172138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:41.173660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:41.196618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 613/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:41.205015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:41.338410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405561cb-def4-46a7-ad78-a46cc58e13c2 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:41.382467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:41.383019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:41.383326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:41.383709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:41.422632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:41.465912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:41.467658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:41.586817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 601/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:33:41.593153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:41.621082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:41.746927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cb70-7166-45d7-8d7f-35ec6a74414f None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:41.786524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:41.787119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:41.787399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:41.787671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:41.801813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:41.803677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:41.825305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:41.826592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:41.827713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:41.827713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:41.827713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:41.831215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 614/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:41.832451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:41.900848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:41.950022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409edf3-8984-466f-b3f5-12b98f482bbf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:41.989549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:41.990185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:41.990474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:41.990743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:41.991420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:41.991728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:41.993105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:42.013204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 602/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:42.015163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:42.110224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:42.153700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358bb1-440c-4087-bd70-3b27555c43ed None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:42.192304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:42.193009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:42.193297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:42.193604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:42.206168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:42.206168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:42.219679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:42.220857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:42.221980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:42.223662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 615/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:42.229323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:42.349039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc0e4-1b61-413e-a73e-15eba7cb9d68 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:42.384620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:42.399268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:42.399897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:42.400236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:42.400545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:42.402182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:42.402586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:42.404293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcc6a2-f139-48cd-a7e6-17445eeacaf5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:42.418098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 603/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:42.423775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:42.533690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e236-e670-4e2b-b5e2-83ee3329c0a5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:42.563980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:42.570604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:42.571251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:42.571533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:42.571852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:42.572714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=5142c9bc9ea44b61919dbb527904ef55) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:42.573456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:42.574901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee7f5-8cb1-4672-8bd6-ebcc3c1737b6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:42.581118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 616/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:42 2022] GET /identity/v3/role_assignments?user.id=5142c9bc9ea44b61919dbb527904ef55&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:44.514271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f85a-d95b-44a4-ab45-f5b128d5bdaf None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:44.514827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f85a-d95b-44a4-ab45-f5b128d5bdaf None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:44.514827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f85a-d95b-44a4-ab45-f5b128d5bdaf None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:44.516340 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 604/1220] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:44.521386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:44.521895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:44.522034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:44.540347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:44.541626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:44.616856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 617/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:44.900737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027f85a-d95b-44a4-ab45-f5b128d5bdaf None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.021506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027f85a-d95b-44a4-ab45-f5b128d5bdaf None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.061977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.062618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.062900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.063178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.073827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:45.078748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:45.081176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:45.082415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 605/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:45.086055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.201876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311f98-6eb3-492f-91aa-4cb90e7d6fa5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.226205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:45.238701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.239315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.239599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.239875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.240544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:45.240848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:45.242241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:45.250812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 618/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:45.256588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.306684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:45.372644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544968b3-e3fc-4623-94d4-b8f81d773326 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.415719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.416367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.417234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.417514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.428969 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:45.430580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:45.446692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:45.447853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:45.448790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:45.448790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:45.448790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:45.448790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 606/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:45.454313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.569724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e77e0-5211-492b-8e78-7447fe7c1d23 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.611532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.612154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.612476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.612796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.613497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:45.613816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:45.615276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:45.628179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 619/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:45.634816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.740940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:45.748386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4e70-62c9-43f3-b0ee-416d18ab2b8a None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.785031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.785722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.786095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.786395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.795434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:45.796901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:45.809139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:45.810981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:45.812378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 607/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:45.816358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:45.867904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:45.928420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784a547-8a11-464e-aa60-54ca944fbdc8 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:45.966671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:45.967316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:45.967629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:45.967941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:45.968761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:45.969122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:45.970698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:45.990887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 620/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:45.997822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:46.111358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3ce8-f3a4-4363-9f45-3e9ad27ed614 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:46.146570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:46.147205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:46.147491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:46.147785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:46.159016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:46.160443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:46.175216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:46.180731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:46.181898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:46.181898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:46.181898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:46.181898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 608/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:46.182542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:46.289226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08696bc2-9892-44dc-bc5d-97e9910bd1c6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:46.292697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:46.325859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:46.326527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:46.326871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:46.327095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:46.327730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:46.328034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:46.329412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:46.347295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 621/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:46.348766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:46.364021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:46.475790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019782-fca7-4c5d-a326-12cbb8eda9b5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:46.516588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:46.517282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:46.517655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:46.517980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:46.525227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:46.528723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:46.541780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:46.542932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:46.544005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 609/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:46.549086 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:46.661535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f1566-9b03-4116-9834-c6dc53eeab86 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:46.704573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:46.705201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:46.705484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:46.705762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:46.706490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:46.706795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:46.708215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e16cb-3290-464e-afc3-d591f5d16ef9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:46.721342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 622/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:46.727506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:46.803870 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:46.841523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71cd7-b405-4aff-ae7c-5f6f73e6860f None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:46.876694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:46.877346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:46.877628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:46.877895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/5142c9bc9ea44b61919dbb527904ef55/roles/a61113f7cab7417ba859072aca16182e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:46.893512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=5142c9bc9ea44b61919dbb527904ef55, role_id=a61113f7cab7417ba859072aca16182e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:46.894962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87aab8d-1ab3-4d97-b202-bb2d978d6592 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:46.909944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 610/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:33:46 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/5142c9bc9ea44b61919dbb527904ef55/roles/a61113f7cab7417ba859072aca16182e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:33:48.884670 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3916-b4ff-4820-b3ba-5e1af00bd0bd None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:48.885756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3916-b4ff-4820-b3ba-5e1af00bd0bd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:48.885756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3916-b4ff-4820-b3ba-5e1af00bd0bd None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:48.887212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 623/1233] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:48.895383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:48.895383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:48.895383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:48.913049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:48.914318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:48.988309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 611/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:49.262936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3916-b4ff-4820-b3ba-5e1af00bd0bd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:49.289153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:49.378930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3916-b4ff-4820-b3ba-5e1af00bd0bd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:49.421178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:49.421831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:49.422150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:49.422511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:49.434563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:49.439694 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:49.440807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:49.441805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 624/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 15:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:49.447540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:49.510692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:49.571448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb9839-0b9b-4b44-8ced-31d09303967c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:49.609863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:49.610731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:49.611133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:49.611566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:49.612291 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:49.612670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:49.614065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:49.622893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 612/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 15:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:49.629311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:49.741352 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:49.761326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6e98-f505-4938-a753-92288f201b6a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:49.801616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:49.802290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:49.802573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:49.802850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:49.814660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:49.816417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:49.834128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:49.835308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:49.836298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:49.836298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:49.836298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:49.836298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 625/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:49.842012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:49.954280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cafd-3483-4ed5-8301-a350bb629e3b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:49.964862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:49.993494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:49.994175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:49.994462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:49.994763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:49.995520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:49.995828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:49.997306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:50.010482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 613/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:50.016786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:50.147447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956be7-5053-4ed1-ba9d-88119bde3aad None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:50.189056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:50.189699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:50.190010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:50.190429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:50.193238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:50.200055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:50.202005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:50.215475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:50.216781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:50.217729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 626/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:33:50.223348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:50.333928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b922-f1ee-47bf-9fc1-e99303daf72e None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:50.371037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:50.371645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:50.371937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:50.372217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:50.372923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:50.373316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:50.374898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:50.393975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 614/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:50.400235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:50.509205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7249-5783-4467-80b0-02e79fd7698e None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:50.549355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:50.550062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:50.550343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:50.550647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:50.621887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:50.631331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:50.632990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:50.749453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 627/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:33:50.755473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:50.785270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:50.867658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66965ccd-b902-4d61-bfec-f8073b4b8973 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:50.905494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:50.906274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:50.906548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:50.906821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:50.918551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:50.920230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:50.936910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:50.938497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:50.939553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:50.939553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:50.939553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:50.939553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 615/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:50.944366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:51.044976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:51.051726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d757f8-e6fc-4009-8884-ff7407278fd0 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:51.092159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:51.092736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:51.093023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:51.093558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:51.094371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:51.094813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:51.096400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:51.111839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 628/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:51.118500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:51.216178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:51.240426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3901-e2ac-400b-88ec-073593158139 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:51.278964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:51.279603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:51.279885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:51.280161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:51.288324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:51.289950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:51.304294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:51.305561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:51.306708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 616/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:51.312026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:51.433309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecda8-aef0-45af-bec7-c6f7314d4945 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:51.475403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:51.476100 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:51.476499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:51.476844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:51.477621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:51.478018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:51.480141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c42f5-ef18-4c81-8568-39f699f6ee89 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:51.497076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 629/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:51.504763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:51.634566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eca4a-65c5-4159-b413-f23e46399c1d None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:51.673770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:51.674426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:51.674714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:51.676297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:51.677047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] RBAC: Adding query filter params (role.id=a61113f7cab7417ba859072aca16182e, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=5142c9bc9ea44b61919dbb527904ef55) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:51.677412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:51.679256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b800e0d-bef6-4706-ba8d-00c1f6e5d288 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:51.686382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 617/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:51 2022] GET /identity/v3/role_assignments?user.id=5142c9bc9ea44b61919dbb527904ef55&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=a61113f7cab7417ba859072aca16182e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:53.739478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d33be-8043-4e38-8b81-d4bbe493e6dd None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:53.740144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d33be-8043-4e38-8b81-d4bbe493e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:53.740144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d33be-8043-4e38-8b81-d4bbe493e6dd None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:53.741636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 630/1247] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:53.748389 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:53.748880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:53.749022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:53.756335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:53.772082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:53.773284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:53.850250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 618/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:54.161031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d33be-8043-4e38-8b81-d4bbe493e6dd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:54.183070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:54.295370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d33be-8043-4e38-8b81-d4bbe493e6dd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:54.340800 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:54.341443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:54.341757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:54.342055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:54.353475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:54.359756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:54.362409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:54.363343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 631/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:54.367349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:54.483374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a8e8c-286b-4ff9-9dfb-8182b430b2de None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:54.514815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:54.520236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:54.520945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:54.521326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:54.521716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:54.522502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:54.522899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:54.524340 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:54.533430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 619/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:54.539605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:54.625163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:54.651674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7467-ba8b-48a5-b672-d97688076fd6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:54.695241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:54.696064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:54.696444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:54.696760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:54.709900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:54.711432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:54.728122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:54.729228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:54.730158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:54.730158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:54.730158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:54.730158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 632/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:54.735783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:54.842102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ab3-cab2-4313-a2ae-857637400d63 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:54.878440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:54.879115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:54.879539 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:54.879819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:54.880743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:54.881113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:54.882905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:54.895957 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 620/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:54.903049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:55.019670 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda400-ea91-4cb4-8822-a1416cdc0cff None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:55.049681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:55.060499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:55.061255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:55.061593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:55.062047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:55.071627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:55.073070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:55.086432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:55.087671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:55.088865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 633/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:55.094297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:55.161783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:55.209979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ae84-5776-452e-a2b9-cd78f6633722 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:55.249609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:55.250306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:55.250586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:55.250856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:55.251584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:55.251889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:55.253293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:55.271561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 621/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:55.277851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:55.394838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2dde0-c97a-400b-a77e-0a92858e897d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:55.431950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:55.433174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:55.433482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:55.433732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:55.497245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:55.511161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:55.512615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:55.622601 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 634/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:33:55.628447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:55.736931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591149f-2b1c-4a62-97c5-670b43c8fc01 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:55.751050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:55.776339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:55.776981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:55.777266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:55.777543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:55.788039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:55.789497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:55.805278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:55.806484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:55.807945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:55.807945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:55.807945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:55.807945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 622/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:55.813606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:55.912229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:55.927390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed31e-a456-4f60-9427-ab5cc0cad99b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:55.967245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:55.967861 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:55.968140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:55.968413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:55.969054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:55.969360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:55.970761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:55.983650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 635/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:55.989621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:56.101861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa46b-4184-4f89-827c-13fc5479b4c1 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:56.141172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:56.141827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:56.142216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:56.142432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:56.149942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:56.151495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:56.163774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:56.165289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:33:56.167047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 623/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:56.171462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:56.294644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77bf7-6042-4d27-8c98-cdd2d4d2d2a2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:56.337071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:56.337705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:56.338019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:56.338323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:56.339603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:56.339913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:56.341393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e0ed-8c41-4d46-8fd4-31af1042653b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:56.355009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 636/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:56.361612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:56.389302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:56.469745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15d8c9-0ec0-49c0-91d3-1781cc1340d5 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:56.505383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:56.506017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:56.506305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:56.506578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:56.507312 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=5142c9bc9ea44b61919dbb527904ef55) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:56.507617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:56.509040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f623ed-d728-4247-8d57-b0516155f345 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:56.515564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 624/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:56 2022] GET /identity/v3/role_assignments?user.id=5142c9bc9ea44b61919dbb527904ef55&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:58.494123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af829-ce17-4b41-a320-3b30c24bf642 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:58.495247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af829-ce17-4b41-a320-3b30c24bf642 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:58.495247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af829-ce17-4b41-a320-3b30c24bf642 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:58.496571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 637/1261] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:58.501826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:58.502219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:58.502410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:58.520205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:58.521375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:58.584778 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 625/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:58.855768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af829-ce17-4b41-a320-3b30c24bf642 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:58.867088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:58.957200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af829-ce17-4b41-a320-3b30c24bf642 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:58.990899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:58.991519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:58.991798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:58.992070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.001851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:59.006674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:59.007837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:59.008746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 638/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:59.013915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.032100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:59.118728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83e513-0b61-40d1-90f5-90f3f729de46 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.163977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.164639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.164926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.165170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.165833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:59.166157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:59.167776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:59.178947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 626/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:59.185429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.253870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:59.287328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d056d7c-a3fa-47c3-bb6d-a5b4db5f5009 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.321506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.322173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.322454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.323257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.333227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:59.334690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:59.349496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:59.350654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:59.351958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:59.351958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:59.351958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:59.351958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 639/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:59.356514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.435212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:59.455201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5eef79-c5c7-4128-8be3-3073d75e8a1b None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.488667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.489286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.489571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.489849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.490541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:59.490853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:59.492244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:59.507130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 627/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:59.513537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.611517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8b79-b700-41bb-b8d8-e29726c1892b None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.631487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:59.646630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.647261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.647543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.647814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.655129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:59.656537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:59.667683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:59.668883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:33:59.670123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 640/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:59.674709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.770336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4140-abb4-4ca8-b758-9f2d0c413441 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.813374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.814001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.814279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.814550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.815283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:59.815585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:59.817004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:59.833750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:59.842947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 628/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:59.848629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:59.954017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951510c-862b-4fd7-b869-a2034b2b8e6a None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:59.986760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:59.987377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:59.987658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:59.987935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:59.998624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:00.000055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:34:00.013865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:00.015016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:34:00.016259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:34:00.016259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:00.016259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:34:00.016259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 641/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:00.020882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:00.124337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a8355-d871-4618-90a8-b599aa0197c6 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:00.172020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:00.172626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:00.172903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:00.173175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:00.173825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:00.174161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:00.175722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:00.188300 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 629/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:00.195888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:00.230250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:00.298320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1a8f-c9be-43e1-bc69-a29b1c033ae6 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:00.330970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:00.331588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:00.331868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:00.332137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:00.339344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:00.340764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:34:00.351738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:00.352774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:34:00.359163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 642/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:00.359796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:00.415053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:00.464406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4dbcc-d145-4a32-bbc0-08a6322d2310 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:00.502762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:00.503267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:00.503551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:00.503829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:00.504700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:00.505023 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:00.506482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbda23-4d0e-436b-a8c0-ccb23d71e52b None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:00.519246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 630/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:00.525412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:00.616570 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:00.625514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21cb7c-735f-4755-a6e1-20b6c272e3d2 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:00.659422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:00.660079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:00.660361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:00.660635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] PATH_INFO: `/v3/projects/456711e5223a45e8a54f00205edd003c/users/5142c9bc9ea44b61919dbb527904ef55/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:00.662558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] RBAC: Authorizing `identity:create_grant(project_id=456711e5223a45e8a54f00205edd003c, user_id=5142c9bc9ea44b61919dbb527904ef55, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:00.663987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a80be8-d6b2-4f41-a18d-775ad8e6edde None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:00.676299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 643/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 15:34:00 2022] PUT /identity/v3/projects/456711e5223a45e8a54f00205edd003c/users/5142c9bc9ea44b61919dbb527904ef55/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:34:02.569419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a223-6dd3-4fde-8798-c46849723da8 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:02.569981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a223-6dd3-4fde-8798-c46849723da8 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:02.569981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a223-6dd3-4fde-8798-c46849723da8 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:02.571322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 631/1274] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:02.576493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:02.576874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:02.577046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:02.595403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:02.596589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:02.662317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 644/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:34:02.929438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a223-6dd3-4fde-8798-c46849723da8 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.028553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a223-6dd3-4fde-8798-c46849723da8 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.045120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:03.061405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.062063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.062348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.062621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.072446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:34:03.077813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:03.078909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:03.080086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 632/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 15:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:03.084938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.176852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:03.198428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45edef7-40bc-4f56-86c2-95e8d7ce1c63 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.231988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.232839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.233115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.233382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.234068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:03.234366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:03.235722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:03.243555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 645/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:03.249807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.345553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e54f8-c7d1-4c5b-852a-5a5fc5b5353c None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.378339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.378956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.379233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.379503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.389590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:03.391026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:34:03.404942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:03.406078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:34:03.407236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:34:03.407236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:03.407236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:03.407236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 633/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:03.411979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.510939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9255-d723-4232-a38b-3597243d0de7 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.548002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.548612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.548901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.549178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.549819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:03.550150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:03.551501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:03.564143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 646/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:03.569993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.600776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:03.669088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c103bb-b32e-4203-a6b9-cf3cb65786f7 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.702255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.702882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.703165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.703435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.710659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:03.712066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:34:03.722888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:03.724049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:03.725405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 634/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:03.730314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.734427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:03.830649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c060-119d-4af8-b34c-daf47fcfd3e9 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:03.864357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:03.864964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:03.865249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:03.865524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:03.866277 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:03.866588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:03.868018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:03.886145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 647/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:03.892203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:03.981607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:03.993077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccc13-b70d-4908-a414-f33fe637cf80 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.026672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.027278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.027597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.027854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.093496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.095026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.192085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:04.202403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 635/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 15:34:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:34:04.208211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:04.269413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:04.307992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4412e5-3fca-40f7-b23c-4604efbe176c None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.341922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.342600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.342866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.343138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.353024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.355042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:34:04.369466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:04.371300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:34:04.373382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:34:04.373382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:34:04.373382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:34:04.373382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 648/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:04.377599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:04.473008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e554-2fb3-4c07-9c88-0b8cf228ebaf None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.506530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.507127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.507410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.507682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.508319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:04.508630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.510079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.521194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 636/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 15:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:04.527288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:04.624631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52fcb9-6d3f-4dd0-837c-21b44aa0595d None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.637998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:04.657991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.658614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.658895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.659165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.665556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.667512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:34:04.678577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:04.679610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: ERROR keystone.server.flask.application Sep 01 15:34:04.680717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 649/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 15:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:04.686207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:04.735160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:04.784238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8734-ccc9-49e9-9259-2eaa0e4893e8 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.816650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.817251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.817529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.817805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.818529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:04.818827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.820237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9fab1-e31a-4f9a-aac6-c65e4cc10cbc None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.831874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 637/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 15:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:04.838063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:04.941887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72c1c-7060-42f3-8171-25f93dcd00b1 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:04.974321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:04.974920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:04.975200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:04.975474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:04.976193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] RBAC: Adding query filter params (role.id=bedd80585f4d4d049e3918a1568f5a9d, scope.project.id=456711e5223a45e8a54f00205edd003c, user.id=5142c9bc9ea44b61919dbb527904ef55) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:04.976504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:04.977919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9fe9-4b6e-414b-bc9a-5f944a67ad47 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:04.984495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 650/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 15:34:04 2022] GET /identity/v3/role_assignments?user.id=5142c9bc9ea44b61919dbb527904ef55&scope.project.id=456711e5223a45e8a54f00205edd003c&role.id=bedd80585f4d4d049e3918a1568f5a9d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:06.904576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914f16-c705-432e-8b62-77582648fa41 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:06.905122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914f16-c705-432e-8b62-77582648fa41 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:06.905122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914f16-c705-432e-8b62-77582648fa41 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:06.906485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 638/1288] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:06.911499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:06.911951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:06.912097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:06.930159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:06.931353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:06.960620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:06.998415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 651/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:34:07.286104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd914f16-c705-432e-8b62-77582648fa41 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:07.385030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd914f16-c705-432e-8b62-77582648fa41 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:07.395363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:07.418898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:07.419521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:07.419803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:07.420078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:07.420663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:07.422041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:07.430673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:07.431866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:07.433559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 639/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:34:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:07.438406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:07.535956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26feda-144f-4f0c-837c-ad5a61e42229 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:07.570414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:07.571020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:07.571303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:07.571577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:07.572209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:07.572518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:07.573872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c00-651b-40d2-a904-36b03d55241e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:07.578685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 652/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 15:34:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:07.584593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:07.680763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5d26-dc6f-43af-ae31-7fcf34057403 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:07.713521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:07.714145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:07.714424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:07.714692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] PATH_INFO: `/v3/services` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:07.715313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:07.715611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:07.716946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b168ac5-6711-46bb-8817-d5e38cda2134 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:07.721172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 640/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 15:34:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:09.631617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b1df-7a46-4c25-870c-ea3c1038b575 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:09.632155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b1df-7a46-4c25-870c-ea3c1038b575 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:09.632155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b1df-7a46-4c25-870c-ea3c1038b575 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:09.633519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 653/1293] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:09.638696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41269-132b-4d5b-9858-c53855b82761 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:09.639098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41269-132b-4d5b-9858-c53855b82761 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:09.639257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e41269-132b-4d5b-9858-c53855b82761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:09.658477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-35e41269-132b-4d5b-9858-c53855b82761 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:09.659685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-35e41269-132b-4d5b-9858-c53855b82761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:09.689438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:09.725949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 641/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:34:09.998207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b1df-7a46-4c25-870c-ea3c1038b575 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:10.028871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:10.099225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b1df-7a46-4c25-870c-ea3c1038b575 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:10.141722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:10.142440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:10.142830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:10.143173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:10.143919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:10.145622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db446-c623-448e-89b8-4580f05f802c None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:10.165408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 654/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 15:34:09 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:34:12.079378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7547fb-0b0c-4f01-8dbd-3a4a829e497c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:12.079900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7547fb-0b0c-4f01-8dbd-3a4a829e497c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:12.079994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7547fb-0b0c-4f01-8dbd-3a4a829e497c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:12.081273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 642/1296] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:12.086365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:12.086787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:12.086927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:12.107184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:12.108648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:12.179647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 655/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:34:12.450189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7547fb-0b0c-4f01-8dbd-3a4a829e497c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:12.556181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7547fb-0b0c-4f01-8dbd-3a4a829e497c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:12.589753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:12.590432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:12.590711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:12.590981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:12.591564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:12.592911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:12.601554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:12.602728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:12.603586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 643/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:34:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:12.609354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:12.627292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:12.708174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c526a-3eff-4554-b5e7-66d46f0a6928 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:12.741695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:12.742328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:12.742613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:12.742885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:12.743510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:12.743810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:12.745768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:12.750860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 656/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 15:34:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:12.756914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:12.787084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:12.853076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e600cc-465d-44ac-ba4b-e9d6b28c1d73 None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:12.886902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:12.887750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:12.888236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:12.888723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:12.890053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] RBAC: Adding query filter params (interface=public, service_id=a6359d1804274b9eb18899ca8f3c504e, region_id=RegionOne) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:12.890620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:12.892965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4ad4-d8ff-4f6c-a3b2-b1c5e305450a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:12.900399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 644/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 15:34:12 2022] GET /identity/v3/endpoints?service_id=a6359d1804274b9eb18899ca8f3c504e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:34:12.906364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:12.986498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:13.004912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329114c2-13ad-48ad-9fac-bb70a1bbaed5 None admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:13.037594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:13.038219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:13.038508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:13.038777 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:13.039371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:13.040729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70e71d-7366-4e18-84dc-377ab8efd58e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:13.047941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 657/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 15:34:12 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:34:14.985151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1587d-6721-4d45-983d-8c613d5d756e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:14.985663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1587d-6721-4d45-983d-8c613d5d756e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:14.985663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1587d-6721-4d45-983d-8c613d5d756e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:14.987197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 645/1302] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:14.992611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:14.993066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:14.993159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:15.011927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:15.013122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:15.081309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 658/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:34:15.353181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1587d-6721-4d45-983d-8c613d5d756e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:15.445266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:15.452621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1587d-6721-4d45-983d-8c613d5d756e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:15.486180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:15.486814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:15.487099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:15.487378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] PATH_INFO: `/v3/services/placement` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:15.487977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:15.489357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:34:15.500774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:34:15.502044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application with Lock( Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:34:15.503223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: ERROR keystone.server.flask.application Sep 01 15:34:15.505050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 646/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 15:34:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:34:15.511655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:15.594276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:15.617988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a415a-0365-4393-a36c-f6b772e237e7 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:15.651044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:15.651653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:15.651937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:15.652213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] PATH_INFO: `/v3/services` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:15.652841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:34:15.653145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:15.654563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01413da-8ca9-4840-9d7e-8352276db26e None admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:15.659686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 659/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 15:34:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:34:15.665644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:15.763056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327494-ed24-43f5-acf3-6138d55008be None admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:15.796271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:15.796869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:15.797147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:15.797419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:15.798108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:15.799460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f063955-4de6-40a1-ac9d-ee9d3ab7950a None admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:15.819228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 647/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:34:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:34:25.656589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=30 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:25.815021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:20.305213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a23-0dfb-447a-a5a4-bdd25435cc20 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:20.305718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a23-0dfb-447a-a5a4-bdd25435cc20 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:20.305802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a23-0dfb-447a-a5a4-bdd25435cc20 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:20.308387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 660/1307] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:20.313691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7114-30de-422d-9147-b100a1d2db8b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:20.314186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7114-30de-422d-9147-b100a1d2db8b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:20.314290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7114-30de-422d-9147-b100a1d2db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:20.426171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-809a7114-30de-422d-9147-b100a1d2db8b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:20.427408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-809a7114-30de-422d-9147-b100a1d2db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:20.544324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 648/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:20.843699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:20.844000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:20.844416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:20.846095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 661/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Sep 1 15:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:20.852109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3f15-f2bd-4fb1-af90-f1d88f28e2b0 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:20.852400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3f15-f2bd-4fb1-af90-f1d88f28e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:20.852674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3f15-f2bd-4fb1-af90-f1d88f28e2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:20.933718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7f9c3f15-f2bd-4fb1-af90-f1d88f28e2b0 None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:20.934971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7f9c3f15-f2bd-4fb1-af90-f1d88f28e2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:20.960414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:21.027518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 649/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Sep 1 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:21.038346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:21.040156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:21.170249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb61e-c9ba-448c-92d8-14d57254fe68 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:21.253618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:21.254431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:21.254820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:21.255201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:21.256923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:21.315784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:21.375760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:21.377289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d381-1e8d-4f3b-b1eb-86cb680be5e7 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:21.397029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 662/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:23.619476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53c2e-36ed-48e4-bd71-980a35b76e7e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:23.620045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53c2e-36ed-48e4-bd71-980a35b76e7e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:23.620045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53c2e-36ed-48e4-bd71-980a35b76e7e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:23.621541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 650/1312] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:23.626631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bb101-8689-4b11-b3a3-b10425e5ae3d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:23.627033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bb101-8689-4b11-b3a3-b10425e5ae3d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:23.627183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bb101-8689-4b11-b3a3-b10425e5ae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:23.710814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a83bb101-8689-4b11-b3a3-b10425e5ae3d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:23.712617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a83bb101-8689-4b11-b3a3-b10425e5ae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:23.825338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 663/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:35:24.123433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:24.123717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:24.123990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:24.125388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 651/1314] 10.222.0.64 () {54 vars in 965 bytes} [Thu Sep 1 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:24.132074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172385b-02b0-43ea-aea4-d6b8a364f622 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:24.132473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172385b-02b0-43ea-aea4-d6b8a364f622 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:24.132760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172385b-02b0-43ea-aea4-d6b8a364f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:24.145094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:24.211672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5172385b-02b0-43ea-aea4-d6b8a364f622 None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:24.217782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5172385b-02b0-43ea-aea4-d6b8a364f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:24.301535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 664/1315] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Sep 1 15:35:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:24.311345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:24.312899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:24.419181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e027e6-f43c-499b-a7ec-d3712af49844 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:24.488842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:24.492588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:24.493391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:24.493839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:24.494324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:24.495958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:24.609447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:24.611192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c7a67-febe-4b0f-89fe-232d3adc7e03 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:24.632355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 652/1316] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:27.077023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:27.077565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:27.077565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:27.078950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 665/1317] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:27.084109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e33514-1dd8-4630-8ff7-3a41997402e4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:27.084495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e33514-1dd8-4630-8ff7-3a41997402e4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:27.084624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e33514-1dd8-4630-8ff7-3a41997402e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:27.150700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d5e33514-1dd8-4630-8ff7-3a41997402e4 None None] MFA Rules not processed for user `0e711eacca6c464aaaf7a9b442a7ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:27.151897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d5e33514-1dd8-4630-8ff7-3a41997402e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:27.202803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:27.247028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 653/1318] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:27.529014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:27.530574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:27.638084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c685-d023-41a2-b2d6-f6e25cf7c39b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:27.640884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:27.712015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:27.712658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:27.712942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:27.713222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:27.715103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:27.821629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:27.826023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fd6a-6479-44d3-8f96-9735b90fd70a service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:27.845764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 666/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:30.345629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.346226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.346226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.347583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 654/1320] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:30.352846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e688c-08e8-40a5-be27-4dac17d984eb None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.353871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e688c-08e8-40a5-be27-4dac17d984eb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.353871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e688c-08e8-40a5-be27-4dac17d984eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.394488 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:30.420128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d57e688c-08e8-40a5-be27-4dac17d984eb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:30.421341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d57e688c-08e8-40a5-be27-4dac17d984eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.520091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 667/1321] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:30.801794 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:30.803387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.904574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c645129-cc7c-42b7-a4d6-c8b41050d916 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:30.984716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:30.985496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.985768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.986069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.987652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.995859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:31.096699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:31.098240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909fc4-e505-41f2-b7f7-4841deb24817 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:31.120207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 655/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:33.949508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:33.950056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:33.950056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:33.951532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 668/1323] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:33.956443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce595-ad3a-47a5-aec0-a2082e483e6f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:33.956909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce595-ad3a-47a5-aec0-a2082e483e6f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:33.957001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce595-ad3a-47a5-aec0-a2082e483e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:34.025922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0e7ce595-ad3a-47a5-aec0-a2082e483e6f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:34.027159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0e7ce595-ad3a-47a5-aec0-a2082e483e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:34.084273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:34.128761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 656/1324] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:34.411399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:34.413000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:34.518193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7b105-b3f6-4c8a-8702-c48a72b9ae41 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:34.531724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:34.594752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:34.595018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:34.595143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:34.595419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:34.597026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:34.726725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:34.728836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1815b-28b5-4688-bec4-e58efc73cb1d service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:34.747147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 669/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:36.712953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.713512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.713512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.714838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 657/1326] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:36.720451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed447c4-e3ab-4f62-b0cd-2e4d6e1cfb89 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.720940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed447c4-e3ab-4f62-b0cd-2e4d6e1cfb89 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.721055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed447c4-e3ab-4f62-b0cd-2e4d6e1cfb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.775293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:36.795965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-bed447c4-e3ab-4f62-b0cd-2e4d6e1cfb89 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:36.797197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-bed447c4-e3ab-4f62-b0cd-2e4d6e1cfb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:36.898745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 670/1327] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:37.176715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:37.178377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:37.292828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86d686-1af3-43b5-80dd-5b7002b55b83 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:37.367747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:37.368357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:37.368637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:37.369509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:37.371160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:37.387667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:37.480685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:37.482179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c682a05-fb46-4947-9278-80dea0a5b727 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:37.500638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 658/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:39.480697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:39.481155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:39.481256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:39.482833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 671/1329] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:39.488392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2e06-1534-4763-9955-648a3453950d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:39.488841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2e06-1534-4763-9955-648a3453950d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:39.489017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2e06-1534-4763-9955-648a3453950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:39.561310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-11da2e06-1534-4763-9955-648a3453950d None None] MFA Rules not processed for user `0e711eacca6c464aaaf7a9b442a7ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:39.562573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-11da2e06-1534-4763-9955-648a3453950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:39.628130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:39.662647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 659/1330] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:39.948447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:39.949982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:40.067879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe68d6-add7-467c-8fa1-4021d5d8bc1d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:40.088831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:40.143419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:40.144030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:40.144313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:40.144585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:40.146218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:40.255237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:40.256569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160ca33-4f22-4740-9cce-f7899b8f94ab service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:40.276040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 672/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:42.448476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:42.449061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:42.449061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:42.450425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 660/1332] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:42.455623 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031bba-c70e-47da-a45d-bfd854860715 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:42.456040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031bba-c70e-47da-a45d-bfd854860715 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:42.456168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031bba-c70e-47da-a45d-bfd854860715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:42.519074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:42.522439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c3031bba-c70e-47da-a45d-bfd854860715 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:42.524014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c3031bba-c70e-47da-a45d-bfd854860715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:42.622322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 673/1333] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:42.906050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:42.907565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:43.010176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8342bc-b5fc-4e16-a8b2-f6c49218a392 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:43.081603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:43.082242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:43.082526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:43.082800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:43.084401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:43.111938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:43.192418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:43.193759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ae3ee-a49e-4550-b45c-bbf5f367005d service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:43.212215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 661/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:45.170398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:45.170980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:45.170980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:45.172287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 674/1335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:45.177437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af59cf-716d-4440-ac02-b062333db783 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:45.177822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af59cf-716d-4440-ac02-b062333db783 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:45.178020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af59cf-716d-4440-ac02-b062333db783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:45.245802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b7af59cf-716d-4440-ac02-b062333db783 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:45.247093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b7af59cf-716d-4440-ac02-b062333db783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:45.325326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:45.352634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 662/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:45.643430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:45.644967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:45.749300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164cd0-f70f-4606-a649-a665ac6c749b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:45.778763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:45.824132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:45.824745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:45.825026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:45.825299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:45.826946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:45.938505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:45.939860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de1ac-378e-46d6-a8c9-65724e5cbdd9 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:45.958182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 675/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:48.215588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:48.216174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:48.216174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:48.217469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 663/1338] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:48.222560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac033a7-f92f-4075-ad72-8a78c9289d44 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:48.222958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac033a7-f92f-4075-ad72-8a78c9289d44 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:48.223120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac033a7-f92f-4075-ad72-8a78c9289d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:48.296295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-eac033a7-f92f-4075-ad72-8a78c9289d44 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:48.297530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-eac033a7-f92f-4075-ad72-8a78c9289d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:48.306062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:48.395285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 676/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:48.680068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:48.681601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:48.782829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a76f2-4aa3-4b88-b5fe-0a381a1ccb33 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:48.855835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:48.856440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:48.856728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:48.856986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:48.858592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:48.893095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:48.965564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:48.966928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f060716-2100-4f30-b130-2b8602f9027d service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:48.985379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 664/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:52.866364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:52.866914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:52.867027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:52.868400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 677/1341] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:52.873691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839670d9-18aa-4b8e-a2c7-0e7c65419c00 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:52.874156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839670d9-18aa-4b8e-a2c7-0e7c65419c00 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:52.874408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839670d9-18aa-4b8e-a2c7-0e7c65419c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:52.947805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-839670d9-18aa-4b8e-a2c7-0e7c65419c00 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:52.948971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-839670d9-18aa-4b8e-a2c7-0e7c65419c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:53.034759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:53.047432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 665/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:53.339041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:53.340558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:53.445869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd41c4-58eb-47b4-907f-1c13d69b0ab6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:53.485310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:53.525881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:53.526525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:53.526813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:53.527088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:53.528710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:53.641703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:53.643412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2018-1583-486c-be7c-09da12e2ea44 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:53.662272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 678/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:56.384464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.384998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.385099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.386487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 666/1344] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:56.391835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0449d-117b-4aba-9ad8-76c2e9fd8bdd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.392255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0449d-117b-4aba-9ad8-76c2e9fd8bdd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.392459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0449d-117b-4aba-9ad8-76c2e9fd8bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.458884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-41a0449d-117b-4aba-9ad8-76c2e9fd8bdd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:56.460052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-41a0449d-117b-4aba-9ad8-76c2e9fd8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.479017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:56.560273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 679/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:56.841517 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:56.843147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.953667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2051-6612-4995-8f60-d84f3ffbd93c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:57.025818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:57.026460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:57.026742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:57.027015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:57.028604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:57.073121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:57.154438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:57.155886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9443e1-47f7-4001-ac72-1504a5174c18 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:57.175452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 667/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:01.401100 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:01.401673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:01.401673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:01.403063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 680/1347] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:01.408601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b1e-d63e-4b8a-a7dc-10ca9760da72 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:01.409092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b1e-d63e-4b8a-a7dc-10ca9760da72 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:01.409184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334b1e-d63e-4b8a-a7dc-10ca9760da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:01.480129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5a334b1e-d63e-4b8a-a7dc-10ca9760da72 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:01.481355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5a334b1e-d63e-4b8a-a7dc-10ca9760da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:01.583030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:01.585736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 668/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:01.875370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:01.876937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:01.987439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7c6a-7672-4a29-bb26-2287939a02ab None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:02.037735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:02.063464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:02.064073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:02.064420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:02.064622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:02.066251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:02.176458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:02.177899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6aacd9-29d9-4728-8b6f-1b8708576b75 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:02.196164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 681/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:07.204839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efcf2-8814-44af-9011-4f43dc9e6bdb None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:07.204839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efcf2-8814-44af-9011-4f43dc9e6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:07.205396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efcf2-8814-44af-9011-4f43dc9e6bdb None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:07.206845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 669/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:07.211917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30093-6e4c-4aba-8d00-2a131f0e39fe None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:07.212410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30093-6e4c-4aba-8d00-2a131f0e39fe None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:07.213119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30093-6e4c-4aba-8d00-2a131f0e39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:07.334040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9fe30093-6e4c-4aba-8d00-2a131f0e39fe None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:07.334040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9fe30093-6e4c-4aba-8d00-2a131f0e39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:07.391679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:07.491846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 682/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:36:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:11.595303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688022-6ffd-44b8-b82d-c609897f28e9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:11.596191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688022-6ffd-44b8-b82d-c609897f28e9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:11.596466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688022-6ffd-44b8-b82d-c609897f28e9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:11.598026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 670/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:11.604040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8e0f-2083-44a4-9014-633d7b404af2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:11.604596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8e0f-2083-44a4-9014-633d7b404af2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:11.604596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8e0f-2083-44a4-9014-633d7b404af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:11.682498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-80ac8e0f-2083-44a4-9014-633d7b404af2 None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:11.683965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-80ac8e0f-2083-44a4-9014-633d7b404af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:11.762275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:11.803078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 683/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:13.245565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b113b8-cc4d-4127-9bda-b55b12d81cb1 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:13.246268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b113b8-cc4d-4127-9bda-b55b12d81cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:13.246268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b113b8-cc4d-4127-9bda-b55b12d81cb1 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:13.247462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 671/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:13.252817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413f03-a2f0-40ea-8db8-b1c45523dcd0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:13.253295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413f03-a2f0-40ea-8db8-b1c45523dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:13.253423 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74413f03-a2f0-40ea-8db8-b1c45523dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:13.335374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-74413f03-a2f0-40ea-8db8-b1c45523dcd0 None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:13.336713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-74413f03-a2f0-40ea-8db8-b1c45523dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:13.446340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 684/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:16.816037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c245a-539d-41ff-af86-0d789aa374e0 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:16.816580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c245a-539d-41ff-af86-0d789aa374e0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:16.816580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c245a-539d-41ff-af86-0d789aa374e0 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:16.817919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 672/1356] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:16.823607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e3be-374d-4085-b179-713dd4a34e25 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:16.824015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e3be-374d-4085-b179-713dd4a34e25 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:16.824160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e3be-374d-4085-b179-713dd4a34e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:16.868847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:16.911431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-df18e3be-374d-4085-b179-713dd4a34e25 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:16.912634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-df18e3be-374d-4085-b179-713dd4a34e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:17.037718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 685/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:17.342633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:17.343113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:17.343541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:17.345300 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 673/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 15:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:17.353556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0c49-7f5d-4c03-8fa2-da0558ffc3d1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:17.354177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0c49-7f5d-4c03-8fa2-da0558ffc3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:17.354608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0c49-7f5d-4c03-8fa2-da0558ffc3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:17.445820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-355a0c49-7f5d-4c03-8fa2-da0558ffc3d1 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:17.447867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-355a0c49-7f5d-4c03-8fa2-da0558ffc3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:17.501375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:17.578886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 686/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:17.587041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:17.589146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:17.746193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133b249-5d44-4e79-bec3-5abdbba7402b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:17.823803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:17.866707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:17.867661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:17.868104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:17.868380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:17.869999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:17.980490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:17.982128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e69e4-d60c-4e46-93e9-5b44023a507e service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:18.010153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 674/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:20.155172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:20.155738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:20.155738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:20.157397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 687/1361] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:20.164233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247675-4850-43c7-b3b6-85e865ca61fa None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:20.164820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247675-4850-43c7-b3b6-85e865ca61fa None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:20.164820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247675-4850-43c7-b3b6-85e865ca61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:20.242208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-42247675-4850-43c7-b3b6-85e865ca61fa None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:20.244047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-42247675-4850-43c7-b3b6-85e865ca61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:20.286582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:20.351895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 675/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:20.656999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:20.658923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:20.860597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacda14-cc02-4ad1-b066-e293bfcfee48 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:20.871608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:20.990650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:20.991842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:20.992192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:20.992537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:20.994785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:21.103958 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:21.106012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbfea0-a36c-4f9d-8e26-349db2f9c292 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:21.133312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 688/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:23.419942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cacb-97f3-4967-92ff-2dbe836b2e0e None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.420537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cacb-97f3-4967-92ff-2dbe836b2e0e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.420537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084cacb-97f3-4967-92ff-2dbe836b2e0e None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.421851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 676/1364] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:23.427453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4ebc-88b7-467b-91e3-bd32c029925b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.427878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4ebc-88b7-467b-91e3-bd32c029925b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.428019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4ebc-88b7-467b-91e3-bd32c029925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.449348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:23.507787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6e3b4ebc-88b7-467b-91e3-bd32c029925b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:23.508998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6e3b4ebc-88b7-467b-91e3-bd32c029925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:23.614877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 689/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:23.913026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.913922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.914374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.916158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 677/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 15:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:23.921711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4dbc-4f70-4b1b-8cfc-463ce9f2eff7 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.922187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4dbc-4f70-4b1b-8cfc-463ce9f2eff7 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.922569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4dbc-4f70-4b1b-8cfc-463ce9f2eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:24.005496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5c1b4dbc-4f70-4b1b-8cfc-463ce9f2eff7 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:24.006849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5c1b4dbc-4f70-4b1b-8cfc-463ce9f2eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:24.046959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:24.146502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 690/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:24.147736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:24.149444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:24.309138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50cad-4ea9-49f0-bbc3-ed7e7c95d7c2 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:24.333130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:24.434381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:24.435946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:24.436461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:24.437084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:24.439140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:24.535588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:24.537546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e0ded-398f-41cd-a37f-7ef331c371b7 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:24.556441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 678/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:25.158409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2c24-952f-481f-908b-f24a1394757d None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:25.158941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2c24-952f-481f-908b-f24a1394757d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:25.158941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2c24-952f-481f-908b-f24a1394757d None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:25.160467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 691/1369] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:25.165647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b15d8-7cb4-439a-85e4-f8d446e0e9d5 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:25.165941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b15d8-7cb4-439a-85e4-f8d446e0e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:25.166252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b15d8-7cb4-439a-85e4-f8d446e0e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:25.200393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:25.238690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-4f9b15d8-7cb4-439a-85e4-f8d446e0e9d5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:25.239897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4f9b15d8-7cb4-439a-85e4-f8d446e0e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:25.343861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 679/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:25.930316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:25.930316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:25.930316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:25.932608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 692/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Sep 1 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:25.936087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c888c-4318-4d4e-aea5-e0384f391e1f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:25.936563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c888c-4318-4d4e-aea5-e0384f391e1f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:25.936837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c888c-4318-4d4e-aea5-e0384f391e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.018053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-193c888c-4318-4d4e-aea5-e0384f391e1f None None] MFA Rules not processed for user `17712d9631894617aa1011ac36582543`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:26.019460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-193c888c-4318-4d4e-aea5-e0384f391e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.070607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.101483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 680/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Sep 1 15:36:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:26.109323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:26.110855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.223495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c531-d69d-487b-9839-afe2d47d0b6c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:26.266099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.306634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:26.307276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.307555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.307821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.309522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.435965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:26.437762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c7625-2d53-432d-aa8f-83198f137a3c service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:26.466445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 693/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:26.587411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.587746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.588054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.589470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 681/1374] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:26.594709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b984-01b0-48f9-887f-fc0a8e4de64c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.595003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b984-01b0-48f9-887f-fc0a8e4de64c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.595434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b984-01b0-48f9-887f-fc0a8e4de64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.678240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ef93b984-01b0-48f9-887f-fc0a8e4de64c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:26.680138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ef93b984-01b0-48f9-887f-fc0a8e4de64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.713923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.795645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 694/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:27.085261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:27.086961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:27.240159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c084dd-84ec-4694-89ed-0f088e525264 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:27.291503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:27.355458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:27.355981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:27.356257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:27.356522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:27.358294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:27.448612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:27.450227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398b42-3acc-47ae-a492-e0687ebb9eba service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:27.468797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 682/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:29.440956 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:29.441499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:29.441499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:29.442906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 695/1377] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:29.448138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99ddb-9f97-4c7c-b55d-e17332de2d0b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:29.448544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99ddb-9f97-4c7c-b55d-e17332de2d0b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:29.448706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99ddb-9f97-4c7c-b55d-e17332de2d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:29.524624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-44a99ddb-9f97-4c7c-b55d-e17332de2d0b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:29.526490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-44a99ddb-9f97-4c7c-b55d-e17332de2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:29.537029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:29.660443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 683/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:29.952577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:29.954158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:30.166831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356925c0-9fe9-43a8-b7e3-cd77907ea703 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:30.174868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:30.321162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:30.321897 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:30.322396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:30.322514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:30.324164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:30.450244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:30.451854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77fa0-d529-4cbe-ac2a-87557aae9a20 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:30.472967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 696/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:32.499725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:32.500310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:32.500310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:32.501859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 684/1380] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:32.507503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6dbf8-ad10-45f0-ace9-0f1068433bbf None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:32.508068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6dbf8-ad10-45f0-ace9-0f1068433bbf None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:32.508068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6dbf8-ad10-45f0-ace9-0f1068433bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:32.523563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:32.586679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a0a6dbf8-ad10-45f0-ace9-0f1068433bbf None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:32.588287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a0a6dbf8-ad10-45f0-ace9-0f1068433bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:32.699965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 697/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:33.007435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:33.009074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:33.194679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:33.207839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fea94b-55b8-411c-857d-3adca40722ea None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:33.328385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:33.329169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:33.329552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:33.329954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:33.331705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:33.427437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:33.429205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35716b-5f0a-47f9-b4de-a1707d2eb960 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:33.440813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:33.451000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 685/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:35.440970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:35.441532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:35.441532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:35.442917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 698/1383] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:35.450914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e13-9686-405d-84bc-5f3213f74382 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:35.451542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e13-9686-405d-84bc-5f3213f74382 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:35.451542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e13-9686-405d-84bc-5f3213f74382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:35.526166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a1b39e13-9686-405d-84bc-5f3213f74382 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:35.528728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a1b39e13-9686-405d-84bc-5f3213f74382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:35.642006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 686/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:35.933853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:35.937366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:36.101729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:36.168063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e16d-d57e-4769-984c-3ef2c769595e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:36.295517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:36.296214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:36.296634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:36.296992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:36.299069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:36.354495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:36.409546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:36.411164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a313b5-3ce4-4236-bdd1-bccf95befc80 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:36.429622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 699/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:38.635298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:38.635836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:38.635836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:38.637288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 687/1386] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:38.643529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19328b89-0d98-4017-828f-d23f9b2c1859 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:38.644257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19328b89-0d98-4017-828f-d23f9b2c1859 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:38.644257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19328b89-0d98-4017-828f-d23f9b2c1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:38.714190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-19328b89-0d98-4017-828f-d23f9b2c1859 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:38.715552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-19328b89-0d98-4017-828f-d23f9b2c1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:38.826266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 700/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:39.209621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:39.211642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:39.304191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:39.382070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b54da-37cb-49a5-971f-14df9021c979 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:39.518635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:39.519192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:39.519509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:39.519785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:39.521497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:39.562523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:39.617061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:39.618850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49af38a-ae91-4861-9534-ff87e2d8bd08 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:39.638583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 688/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:41.598756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932303d3-013c-4e95-bdac-1a50ed371e87 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:41.599722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932303d3-013c-4e95-bdac-1a50ed371e87 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:41.600028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932303d3-013c-4e95-bdac-1a50ed371e87 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:41.601404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 701/1389] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:41.606728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:41.607149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:41.607287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:41.675017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:41.676253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:41.716028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a884-1d9a-43ce-a050-243cd7627948 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:41.716323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a884-1d9a-43ce-a050-243cd7627948 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:41.716588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a884-1d9a-43ce-a050-243cd7627948 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:41.718089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 702/1390] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:36:41.722729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fff1-31b9-4ac5-bc3c-617e513e02a5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:41.723017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fff1-31b9-4ac5-bc3c-617e513e02a5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:41.723297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fff1-31b9-4ac5-bc3c-617e513e02a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:41.762144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:41.780607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 689/1391] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:41.795573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e587fff1-31b9-4ac5-bc3c-617e513e02a5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:41.796775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e587fff1-31b9-4ac5-bc3c-617e513e02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:41.895814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 703/1392] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:42.072363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:42.073576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.088263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.190241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a85b4-fcd5-4124-8026-07be009d8aab None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:42.202952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b83a5-95d4-4999-a26d-e98f561fc7a2 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.203241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b83a5-95d4-4999-a26d-e98f561fc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.203521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b83a5-95d4-4999-a26d-e98f561fc7a2 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.204910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 704/1393] 10.222.0.64 () {54 vars in 967 bytes} [Thu Sep 1 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:42.209893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.210303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.210561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.290973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] MFA Rules not processed for user `2e3a994eec4a44b782d847b132c6eaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:42.292195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.308243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:42.308862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.309143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.309422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.311050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.319588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.341802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.372075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 705/1394] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Sep 1 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:42.379674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:42.387990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505406-7a21-46d8-ab90-b452883cf2e3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:42.405913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:42.407529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c5f6a-728a-4895-b1ff-81d07cd6ab18 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:42.425940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 690/1395] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:42.465239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a994eec4a44b782d847b132c6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:42.465859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.465859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.465859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.468040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.610961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:42.613808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc014f2-45de-47e8-ac1e-b31105dedda0 service glance] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:42.630743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.636999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 706/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:36:43.369733 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378a59-61c9-4614-ba86-9ac23abbbc92 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:43.370250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378a59-61c9-4614-ba86-9ac23abbbc92 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:43.370352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378a59-61c9-4614-ba86-9ac23abbbc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:43.437074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-98378a59-61c9-4614-ba86-9ac23abbbc92 None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:43.438309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-98378a59-61c9-4614-ba86-9ac23abbbc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:43.522850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:43.531590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 691/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:43.575726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:43.576053 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:43.576527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:43.578017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 707/1398] 10.222.0.64 () {54 vars in 943 bytes} [Thu Sep 1 15:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:43.584430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe747f-4a1b-440f-b981-4781a70c53f2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:43.584727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe747f-4a1b-440f-b981-4781a70c53f2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:43.585016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe747f-4a1b-440f-b981-4781a70c53f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:43.662768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-35fe747f-4a1b-440f-b981-4781a70c53f2 None None] MFA Rules not processed for user `356ba9813a5740a2b6495debb9c1e5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:43.663958 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-35fe747f-4a1b-440f-b981-4781a70c53f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:43.776318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 692/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Sep 1 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:43.786383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:43.787909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:43.935239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6bbc-1f08-4dc7-89af-2c8dd65ebb25 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:44.018544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:44.041156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:44.041775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:44.042089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:44.042364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:44.043999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:44.131148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:44.132752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e6938-ff1a-4dca-b90e-da7fa9187cba service swift] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:44.143855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 708/1400] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:36:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:36:44.399460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:44.400097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:44.400097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:44.404401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 693/1401] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:44.407095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bd14-03b7-4225-a195-25aaeb01b2ee None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:44.407389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bd14-03b7-4225-a195-25aaeb01b2ee None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:44.407669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bd14-03b7-4225-a195-25aaeb01b2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:44.493241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-0241bd14-03b7-4225-a195-25aaeb01b2ee None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:44.494620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0241bd14-03b7-4225-a195-25aaeb01b2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:44.580601 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:44.615072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 709/1402] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:44.910397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:44.911929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:44.974923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:45.068972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7aed8-d8c2-4a9f-a17d-94773b13ab61 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:45.204017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:45.204751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:45.205117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:45.205397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:45.207113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:45.227432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:45.308491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:45.310129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42612e3-78d5-4a32-bfac-cee6074ede8f service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:45.332801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 694/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:47.312440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:47.312440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:47.312440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:47.314163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 710/1404] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:47.318530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04534f5-02fa-4fc6-ae91-ffc68ca300eb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:47.318999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04534f5-02fa-4fc6-ae91-ffc68ca300eb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:47.319437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04534f5-02fa-4fc6-ae91-ffc68ca300eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:47.413558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d04534f5-02fa-4fc6-ae91-ffc68ca300eb None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:47.414858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d04534f5-02fa-4fc6-ae91-ffc68ca300eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:47.519302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:47.534115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 695/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:47.836531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:47.838875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:48.034125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795384-ef1a-4340-a9e6-70d0ab04d2df None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:48.105487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:48.182306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:48.182966 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:48.183197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:48.183467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:48.185051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:48.301597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:48.309987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366a8c-4019-4bff-9f7d-50d1325dc7f0 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:48.334252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 711/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:50.337637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:50.338255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:50.338255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:50.339585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 696/1407] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:50.344782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b9e3e-9aee-4425-b22c-c3c84ac499c1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:50.345194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b9e3e-9aee-4425-b22c-c3c84ac499c1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:50.345346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b9e3e-9aee-4425-b22c-c3c84ac499c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:50.417981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ed0b9e3e-9aee-4425-b22c-c3c84ac499c1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:50.419385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ed0b9e3e-9aee-4425-b22c-c3c84ac499c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:50.433598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:50.531051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 712/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:50.833185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:50.834768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:50.997526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5f94-a866-44e3-be53-bc98a4b88022 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:51.096146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:51.150889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:51.151498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:51.151780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:51.152057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:51.153687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:51.264331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:51.266203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415438c4-847c-4d6f-bbb3-e35fc0c5ac0e service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:51.285337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 697/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:00.529329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=38 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:01.282807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=64 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:06.480546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9e0d-bf2e-4ed9-bfd6-16705b43d4b2 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:06.481137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9e0d-bf2e-4ed9-bfd6-16705b43d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:06.481137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9e0d-bf2e-4ed9-bfd6-16705b43d4b2 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:06.482494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 713/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Sep 1 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:37:06.487535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc6987-13e3-4fd1-b565-5a1d7a64fe50 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:06.488222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc6987-13e3-4fd1-b565-5a1d7a64fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:06.488400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc6987-13e3-4fd1-b565-5a1d7a64fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:06.564030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b6bc6987-13e3-4fd1-b565-5a1d7a64fe50 None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:06.565232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b6bc6987-13e3-4fd1-b565-5a1d7a64fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:06.669205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 698/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Sep 1 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:06.683709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9f49-f5dc-4450-883a-069007aab072 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:06.683997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9f49-f5dc-4450-883a-069007aab072 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:06.684275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9f49-f5dc-4450-883a-069007aab072 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:06.685619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 714/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Sep 1 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:37:06.690426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702032d7-b3a4-4c36-a64e-1d4328688820 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:06.690716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702032d7-b3a4-4c36-a64e-1d4328688820 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:06.690995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702032d7-b3a4-4c36-a64e-1d4328688820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:06.763464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:06.767387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-702032d7-b3a4-4c36-a64e-1d4328688820 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:06.768883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-702032d7-b3a4-4c36-a64e-1d4328688820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:06.889326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 699/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Sep 1 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:09.258953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:09.259993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:09.260628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:09.262046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:09.267380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040cc0b-af38-4b5c-8678-5fe1c725f406 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:09.267773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040cc0b-af38-4b5c-8678-5fe1c725f406 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:09.267933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040cc0b-af38-4b5c-8678-5fe1c725f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:09.333379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9040cc0b-af38-4b5c-8678-5fe1c725f406 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:09.334599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9040cc0b-af38-4b5c-8678-5fe1c725f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:09.388344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:09.430152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:09.715264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:09.716814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:09.866922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396e33-65e8-4436-81e1-9e776e769fff None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:09.939221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:09.978685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:09.979285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:09.979568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:09.979836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:09.981422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:10.071474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:10.073083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10266284-0af7-49d3-ba7b-dc57279079e5 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:10.091004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 716/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:10.992088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:10.992624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:10.992624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:10.993938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:10.998925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c272dd-beb0-4e5c-bd55-aff6487f8e62 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:10.999374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c272dd-beb0-4e5c-bd55-aff6487f8e62 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:10.999484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c272dd-beb0-4e5c-bd55-aff6487f8e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:11.076778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-96c272dd-beb0-4e5c-bd55-aff6487f8e62 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:11.078084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-96c272dd-beb0-4e5c-bd55-aff6487f8e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:11.105304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:11.176587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:11.328376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:11.329882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:11.472759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2defd-8010-4d8a-9bcf-aa12db12344b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:11.513380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:11.585283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:11.585808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:11.586127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:11.586396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:11.587987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:11.674956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:11.676561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8de0-bc10-4426-9850-33a865a9d7e4 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:11.695418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 702/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:12.585907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:12.586551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:12.586551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:12.587891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:12.592925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab68d4-0b7a-4178-8bce-15c58c919d64 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:12.593380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab68d4-0b7a-4178-8bce-15c58c919d64 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:12.593487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab68d4-0b7a-4178-8bce-15c58c919d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:12.647506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:12.670644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-67ab68d4-0b7a-4178-8bce-15c58c919d64 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:12.671877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-67ab68d4-0b7a-4178-8bce-15c58c919d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:12.768718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:12.922884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:12.924310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:13.071156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cef6-b14d-4d64-8429-e3e6525f5913 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:13.083559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:13.191991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:13.192517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:13.192798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:13.193071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:13.194731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:13.288283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:13.289914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de645544-4f2a-4b5d-ab2c-076048a6a8d5 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:13.308584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 719/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:14.187217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:14.187851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:14.187851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:14.189179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:14.194714 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e732a-2de0-4e48-90bc-5d14961f8261 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:14.195265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e732a-2de0-4e48-90bc-5d14961f8261 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:14.195265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e732a-2de0-4e48-90bc-5d14961f8261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:14.220365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:14.280540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-988e732a-2de0-4e48-90bc-5d14961f8261 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:14.281755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-988e732a-2de0-4e48-90bc-5d14961f8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:14.378464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:14.534625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:14.536155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:14.645931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:14.682407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c387-c889-4f9f-8007-c76e46cd728f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:14.796052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:14.796573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:14.796850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:14.797120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:14.798758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:14.876363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:14.890129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:14.891781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb34986-4091-4a80-8dde-1b92276ca1ae service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:14.910501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 705/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:15.777860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:15.778356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:15.778543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:15.779961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:15.785024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c776f5-21de-45d2-a197-2f739bcf8503 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:15.785453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c776f5-21de-45d2-a197-2f739bcf8503 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:15.785568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c776f5-21de-45d2-a197-2f739bcf8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:15.861207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-71c776f5-21de-45d2-a197-2f739bcf8503 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:15.862477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-71c776f5-21de-45d2-a197-2f739bcf8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:15.958022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:16.110702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:16.112222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:16.197882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:16.260884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dac4d-064f-4fe1-8b8a-87d03aeebfc5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:16.373026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:16.373640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:16.373917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:16.374221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:16.375829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:16.425004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:16.467247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:16.468855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dff6ef-3047-4ba9-ad9e-ca009c7cebb5 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:16.486846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 722/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:17.293941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:17.294891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:17.294891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:17.296472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:17.301153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925b6d-8d36-4cf3-8862-4e60be68722c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:17.301584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925b6d-8d36-4cf3-8862-4e60be68722c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:17.301680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925b6d-8d36-4cf3-8862-4e60be68722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:17.378479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-05925b6d-8d36-4cf3-8862-4e60be68722c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:17.379617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-05925b6d-8d36-4cf3-8862-4e60be68722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:17.475985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:17.626453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:17.628002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:17.677951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:17.772704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c1471-5674-47e4-bac2-b06aec65604d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:17.884628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:17.885427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:17.885713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:17.886022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:17.887733 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:17.897973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:17.994033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:17.995570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5084a6-a702-497f-a403-280b3623aabf service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:18.013284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 708/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:18.823184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:18.823868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:18.823868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:18.825301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:18.830881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9405-6da8-4eb4-bba3-29fdabccf74c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:18.831467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9405-6da8-4eb4-bba3-29fdabccf74c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:18.831563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9405-6da8-4eb4-bba3-29fdabccf74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:18.908055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-148b9405-6da8-4eb4-bba3-29fdabccf74c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:18.909268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-148b9405-6da8-4eb4-bba3-29fdabccf74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:18.977521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:19.007450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:19.176935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:19.178481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:19.197596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:19.327074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352254-bc57-44c7-9129-f0cc8d3f184c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:19.415346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:19.442064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:19.442635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:19.442919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:19.443194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:19.444822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:19.542221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:19.543832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b21d0-4091-4449-8b5b-bf84e42378cf service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:19.561625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 725/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:20.410213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:20.410795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:20.410795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:20.412125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:20.418228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613288c-e781-43fb-8d99-d08ae5c064dd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:20.418650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613288c-e781-43fb-8d99-d08ae5c064dd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:20.418780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613288c-e781-43fb-8d99-d08ae5c064dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:20.499594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e613288c-e781-43fb-8d99-d08ae5c064dd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:20.500815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e613288c-e781-43fb-8d99-d08ae5c064dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:20.544468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:20.599574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:20.751949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:20.753504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:20.897759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38362fbc-b4c7-4be2-8bb2-54cc4ff549dd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:20.951988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:21.011813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:21.012428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:21.012709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:21.012982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:21.014624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:21.103192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:21.104786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35509ca-46c6-4ace-a874-a11db5c646e3 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:21.122801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 711/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:37:21.939280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:21.939800 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:21.939800 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:21.941148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:21.946785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ff99-5e5e-4f9b-9022-3af1201551b4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:21.947194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ff99-5e5e-4f9b-9022-3af1201551b4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:21.947329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ff99-5e5e-4f9b-9022-3af1201551b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:22.021720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3160ff99-5e5e-4f9b-9022-3af1201551b4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:22.022962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3160ff99-5e5e-4f9b-9022-3af1201551b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:22.025050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:22.124512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:22.278045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:22.279469 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:22.425515 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473143e-d4f2-4108-85f3-5b5468da21b3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:22.452182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:22.537794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:22.538341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:22.538625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:22.539531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:22.541159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:22.629083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:22.630743 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fdd5e-b637-4d12-b791-6accdee460a8 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:22.649027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 728/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:24.485273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:24.485846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:24.485846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:24.487199 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:24.492708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13ee5-a4e8-4a51-a914-88e349467321 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:24.493187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13ee5-a4e8-4a51-a914-88e349467321 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:24.493289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13ee5-a4e8-4a51-a914-88e349467321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:24.535117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:24.561180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-62c13ee5-a4e8-4a51-a914-88e349467321 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:24.563149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-62c13ee5-a4e8-4a51-a914-88e349467321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:24.665315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:24.949515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:24.951149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:25.051699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82785cec-9419-40fd-9b66-94b06594c2f3 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:25.083479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:25.125579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:25.126210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:25.126488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:25.126755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:25.128338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:25.238026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:25.239380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f8b9e-9526-4f33-a405-b3e02630dc94 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:25.258161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 714/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:27.330209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:27.330635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:27.330766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:27.332220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:27.338599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cf5d-541e-435a-8a5b-d85d04c30b7b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:27.339079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cf5d-541e-435a-8a5b-d85d04c30b7b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:27.339213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cf5d-541e-435a-8a5b-d85d04c30b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:27.406602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ec01cf5d-541e-435a-8a5b-d85d04c30b7b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:27.407806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ec01cf5d-541e-435a-8a5b-d85d04c30b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:27.420493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:27.503790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:27.791459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:27.793028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:27.897341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b7bc-ec6c-48be-88fb-25d6fadae209 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:27.910264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:27.981014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:27.981532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:27.981814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:27.982116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:27.983758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:28.092288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:28.093730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bae7d-3918-40c9-968e-29e453ebb255 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:28.111963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 731/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:30.320955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:30.321533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:30.321533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:30.322971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:30.328456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0363-9f1b-4fc8-b7d6-67d469bfa83d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:30.328910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0363-9f1b-4fc8-b7d6-67d469bfa83d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:30.329032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0363-9f1b-4fc8-b7d6-67d469bfa83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:30.377297 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:30.396730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-0faa0363-9f1b-4fc8-b7d6-67d469bfa83d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:30.398576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0faa0363-9f1b-4fc8-b7d6-67d469bfa83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:30.494470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:30.775585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:30.777167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:30.880084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15193f-ee2c-4380-956b-80912c331f42 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:30.919577 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:30.954322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:30.954855 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:30.955137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:30.955412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:30.957100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:31.065631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:31.067105 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f51ec-be81-41c4-93d5-30b8819c1438 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:31.085724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 717/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:33.153475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:33.154076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:33.154076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:33.155380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:33.160669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751671d-c0a8-47e9-a7b8-8f026d7c298f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:33.161099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751671d-c0a8-47e9-a7b8-8f026d7c298f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:33.161222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751671d-c0a8-47e9-a7b8-8f026d7c298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:33.227545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9751671d-c0a8-47e9-a7b8-8f026d7c298f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:33.228774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9751671d-c0a8-47e9-a7b8-8f026d7c298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:33.249531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:33.334279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:33.627593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:33.629132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:33.732968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08be32b-b341-4580-8913-7d41aaedae16 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:33.753431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:33.808033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:33.808638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:33.808918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:33.809218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:33.810825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:33.933248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:33.934635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594f84-6bb9-400a-8550-dea2c907d498 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:33.952865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 734/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:36.037881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:36.038476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:36.038476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:36.039777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:36.045070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2697-3b7e-40a2-a173-373b0dc09c2d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:36.045477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2697-3b7e-40a2-a173-373b0dc09c2d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:36.045626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2697-3b7e-40a2-a173-373b0dc09c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:36.110571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:36.113569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-fbbe2697-3b7e-40a2-a173-373b0dc09c2d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:36.115367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fbbe2697-3b7e-40a2-a173-373b0dc09c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:36.214324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:36.504899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:36.506474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:36.607690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36ef4-058d-4a77-9c17-62d49f68788d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:36.655947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:36.682172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:36.682813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:36.683114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:36.683356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:36.684988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:36.801885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:36.803243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5903803-5680-42ad-acf1-8cefdd3ebaa1 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:36.825619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 720/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:38.818728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:38.819355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:38.819643 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:38.821144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:38.826885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aed85-e5fc-469d-8ab2-d8d1af73b158 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:38.827350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aed85-e5fc-469d-8ab2-d8d1af73b158 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:38.827561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aed85-e5fc-469d-8ab2-d8d1af73b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:38.894747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7c8aed85-e5fc-469d-8ab2-d8d1af73b158 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:38.895986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7c8aed85-e5fc-469d-8ab2-d8d1af73b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:38.928797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:38.997014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:39.284595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:39.286492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:39.391278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d3d5-3634-4bbd-8efe-b1225ff4473c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:39.419215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:39.468118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:39.468984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:39.468984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:39.469268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:39.470953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:39.584319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:39.587172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a5f6b-6db9-4866-8e81-b20d2de57718 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:39.606448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 737/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:41.648599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:41.649139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:41.649139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:41.650532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:41.655926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7298-395e-4bc7-ae51-e6c13a5486f4 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:41.656336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7298-395e-4bc7-ae51-e6c13a5486f4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:41.656490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7298-395e-4bc7-ae51-e6c13a5486f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:41.724104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b65b7298-395e-4bc7-ae51-e6c13a5486f4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:41.725333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b65b7298-395e-4bc7-ae51-e6c13a5486f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:41.733969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:41.826728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:42.115136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:42.117311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:42.222729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319f3a-dffc-4ebf-8e7b-79817cf79ea1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:42.278675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:42.297399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:42.298043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:42.298328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:42.298606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:42.300207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:42.409752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:42.411464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56915-34f1-4540-aba8-eb904ff481fd service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:42.430292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 723/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:44.393275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:44.393943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:44.393943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:44.395241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:44.400519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ed8-faa5-40cf-b00c-91d0f1a9e010 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:44.401010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ed8-faa5-40cf-b00c-91d0f1a9e010 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:44.401125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ed8-faa5-40cf-b00c-91d0f1a9e010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:44.466077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5c026ed8-faa5-40cf-b00c-91d0f1a9e010 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:44.467297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5c026ed8-faa5-40cf-b00c-91d0f1a9e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:44.506767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:44.565641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:44.844984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:44.846544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:44.953599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e610-b556-4c0d-85a7-adc9e87ca824 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:44.990849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:45.026759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:45.027366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:45.027643 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:45.027914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:45.029491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:45.137268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:45.139029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55c54-e5bc-4691-81b7-265177b23810 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:45.157739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 740/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:47.095553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:47.096126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:47.096126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:47.097496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:47.103554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088df67-7ff5-4a24-9661-278e9b64b753 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:47.103984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088df67-7ff5-4a24-9661-278e9b64b753 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:47.104119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088df67-7ff5-4a24-9661-278e9b64b753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:47.175960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b088df67-7ff5-4a24-9661-278e9b64b753 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:47.177171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b088df67-7ff5-4a24-9661-278e9b64b753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:47.196684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:47.277735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:37:47.560035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:47.561570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:47.665557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce4903-9f07-4695-942f-aadd42089529 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:47.736217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:47.744411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:47.745024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:47.745299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:47.745573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:47.747211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:47.854418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:47.855862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727542-2f1e-4cb3-a90e-1420b127e926 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:47.874293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 726/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:49.805397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:49.805923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:49.806067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:49.807490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:49.813037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d205-18b9-4d2b-b9e8-b5d1055d0871 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:49.813459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d205-18b9-4d2b-b9e8-b5d1055d0871 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:49.813589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d205-18b9-4d2b-b9e8-b5d1055d0871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:49.880449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6bd1d205-18b9-4d2b-b9e8-b5d1055d0871 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:49.882294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6bd1d205-18b9-4d2b-b9e8-b5d1055d0871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:49.929871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:49.977757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:50.262049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:50.263590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:50.377322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d7b4-8ec2-4b4e-9b0a-951eaa7a8a8d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:50.430727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:50.456721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:50.457312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:50.457591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:50.457866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:50.459516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:50.568788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:50.570269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c19800-cc88-4a20-8344-5a1cbf7e5ac3 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:50.588862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 743/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:59.975817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=22 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:00.586587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=66 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:10.206505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d98c-69d0-4809-82ca-8bf3cb1f2a23 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:10.207094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d98c-69d0-4809-82ca-8bf3cb1f2a23 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:10.207094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d98c-69d0-4809-82ca-8bf3cb1f2a23 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:10.208448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 728/1471] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:10.213753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64d306-ce6c-42a7-875f-1022a73bc24a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:10.214202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64d306-ce6c-42a7-875f-1022a73bc24a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:10.214388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64d306-ce6c-42a7-875f-1022a73bc24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:10.280642 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-bf64d306-ce6c-42a7-875f-1022a73bc24a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:10.281864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-bf64d306-ce6c-42a7-875f-1022a73bc24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:10.385036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 744/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:10.731821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:10.732151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:10.732468 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:10.733854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 729/1473] 10.222.0.64 () {54 vars in 967 bytes} [Thu Sep 1 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:10.739092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dd8f2-f9d3-4a5a-8f65-cc10503cfc69 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:10.740030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dd8f2-f9d3-4a5a-8f65-cc10503cfc69 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:10.740304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9dd8f2-f9d3-4a5a-8f65-cc10503cfc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:10.816912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5c9dd8f2-f9d3-4a5a-8f65-cc10503cfc69 None None] MFA Rules not processed for user `2e3a994eec4a44b782d847b132c6eaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:10.818214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5c9dd8f2-f9d3-4a5a-8f65-cc10503cfc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:10.839788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:10.895914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 745/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Sep 1 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:10.903538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:10.905050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:11.014911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c713ef3-9705-4a15-b7b1-c0bbe2f44f35 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:11.088032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a994eec4a44b782d847b132c6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:11.088640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:11.088917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:11.089188 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:11.090816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:11.144985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:11.201494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:11.202972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31be686-2d55-41ce-8802-a2f0a4af3514 service glance] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:11.221612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 730/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:13.245158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:13.245780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:13.245906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:13.247302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 746/1476] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:13.254263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ee57-a401-43d6-b6aa-e64faa7e479f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:13.255369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ee57-a401-43d6-b6aa-e64faa7e479f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:13.255485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ee57-a401-43d6-b6aa-e64faa7e479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:13.334423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-87a5ee57-a401-43d6-b6aa-e64faa7e479f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:13.336338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-87a5ee57-a401-43d6-b6aa-e64faa7e479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:13.562737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 731/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:13.838607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:13.840291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:13.969361 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fc04c-7fa6-4acc-bb8b-84e88118f5e3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:14.019612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:14.065442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:14.066080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:14.066358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:14.066625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:14.067335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:14.069110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:38:14.069110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:38:14.069110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:38:14.070276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf8598-a4a1-4293-9433-afd3bfead713 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:14.089420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 747/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 15:38:13 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:38:16.062672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:16.063284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:16.063284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:16.064543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 732/1479] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:16.069778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96e8f-2327-43ae-b5c2-29f9b77ce02c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:16.070259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96e8f-2327-43ae-b5c2-29f9b77ce02c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:16.070364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96e8f-2327-43ae-b5c2-29f9b77ce02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:16.137135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-71a96e8f-2327-43ae-b5c2-29f9b77ce02c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:16.138407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-71a96e8f-2327-43ae-b5c2-29f9b77ce02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:16.356663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 748/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:16.648128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:16.649745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:16.659696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:16.794727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6e25-bf7c-4764-8fc4-1ee5f3681132 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:16.873374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:16.906845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:16.907375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:16.907655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:16.907929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:16.909525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:17.001466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:17.003072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc9aad-6c19-418e-a84d-92c98c21aa32 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:17.021076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 733/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:19.132342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:19.132878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:19.132878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:19.134393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 749/1482] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:19.139805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd4d09-56f4-46cf-a1a8-2cd2081b6cc9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:19.140253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd4d09-56f4-46cf-a1a8-2cd2081b6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:19.140361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd4d09-56f4-46cf-a1a8-2cd2081b6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:19.206149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7bcd4d09-56f4-46cf-a1a8-2cd2081b6cc9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:19.207339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7bcd4d09-56f4-46cf-a1a8-2cd2081b6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:19.252928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:19.302423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 734/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:19.586624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:19.588135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:19.611319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:19.693440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2541ab2-6f6b-4630-bf3e-c547690880fb None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:19.772874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:19.773377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:19.773653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:19.773921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:19.775553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:19.851117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:19.886605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:19.888049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66b748-a230-4a50-ba82-5d1cad79d8aa service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:19.907249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 750/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:21.919544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:21.920108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:21.920108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:21.921479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 735/1485] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:21.926673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eed8ac-06d4-40f8-89be-1eb84eeede62 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:21.927167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eed8ac-06d4-40f8-89be-1eb84eeede62 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:21.927301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eed8ac-06d4-40f8-89be-1eb84eeede62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:22.008334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d2eed8ac-06d4-40f8-89be-1eb84eeede62 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:22.009470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d2eed8ac-06d4-40f8-89be-1eb84eeede62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:22.105542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 751/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:22.395414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:22.396938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:22.498628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515ef2-1bdf-4bc7-9e30-bc117b22cbc5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:22.571131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:22.573008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:22.573591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:22.574072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:22.574582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:22.576427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:22.696653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:22.698327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3185c30-980a-4b72-aeff-d00b16fea1ee service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:22.716061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 736/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:24.782600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:24.783154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:24.783154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:24.784497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 752/1488] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:24.789667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fdba8-59df-4aae-b5bc-fdf9bfdb0460 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:24.790127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fdba8-59df-4aae-b5bc-fdf9bfdb0460 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:24.790262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fdba8-59df-4aae-b5bc-fdf9bfdb0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:24.855819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7c4fdba8-59df-4aae-b5bc-fdf9bfdb0460 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:24.857028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7c4fdba8-59df-4aae-b5bc-fdf9bfdb0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:24.910372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:24.953359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 737/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:25.254329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:25.256462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:25.292837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:25.365628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d008-66de-47da-92d2-f5acb26d5c55 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:25.447856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:25.448460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:25.448738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:25.449010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:25.450671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:25.536272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:25.568414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:25.569932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa045a7-3e8c-4117-ac1c-d71629482e13 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:25.587998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 753/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:27.767089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:27.767615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:27.767615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:27.769035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 738/1491] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 15:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:38:27.774821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ed26-7929-4d6a-a3b0-a1ff9dd10035 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:27.775284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ed26-7929-4d6a-a3b0-a1ff9dd10035 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:27.775384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ed26-7929-4d6a-a3b0-a1ff9dd10035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:27.843536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b678ed26-7929-4d6a-a3b0-a1ff9dd10035 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:38:27.844753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b678ed26-7929-4d6a-a3b0-a1ff9dd10035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:27.944981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 754/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:38:28.239952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:38:28.241478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:28.344277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548111e4-6102-4184-81b1-d6c70307e8fd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:38:28.416472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:38:28.417101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:38:28.417376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:38:28.417643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:38:28.419252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:38:28.428206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:28.528040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:38:28.529394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d009da-d283-4c85-9dd4-3ccc87a26509 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:38:28.546821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 739/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:38:37.943092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=82 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:38:38.544560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=50 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:42.482280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:42.482890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:42.482890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:42.559288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:42.560503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:42.656090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 755/1494] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:42.664199 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:42.664694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:42.664797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:42.740110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:42.741236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:42.839131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 740/1495] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:42.845717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:42.846952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:42.858408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef55f3-222c-4446-a438-87330eb78603 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:42.922011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:42.957889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:42.958517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:42.958790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:42.959057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:42.959691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:39:42.960021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:42.961046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:42.961046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:39:42.961046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:39:42.961949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:42.972925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 756/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:39:42.981388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:42.991321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30fd5f-8809-46a2-91eb-8940c4b43706 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:43.052428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:43.087412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:43.088011 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.088289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.088558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.089202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:43.090967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:43.090967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:39:43.090967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:39:43.092154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:43.150352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 741/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:39:42 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:39:43.154905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:43.156518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:43.196312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b254-a083-418f-808d-080fe89cef03 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:43.292730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:43.293254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.293532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.293803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.294457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:43.295470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:43.295470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:39:43.295470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:39:43.296675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:43.340727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 757/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:39:43 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:39:43.344858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:43.346349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:43.407534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2fb5-ddb3-43bc-b7b6-66791a9dcb9c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:43.490899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:43.502901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:43.503514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.503819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.504091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.504735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:43.505731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:43.505731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:39:43.505731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:39:43.506646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:43.519093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 742/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:39:43.523698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:43.525217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:43.537458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae888-e37f-4d74-935f-f439ce12fd31 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:43.562710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:43.633680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:43.634311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.634588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.634853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.635485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:43.636479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:43.636479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:39:43.636479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:39:43.637353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312fda-0b2d-4b8d-85a3-4482e6aea49b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:43.649969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 758/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:39:43.654219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:43.655735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:43.689006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02d00-e798-4097-a2db-3fbeb210b83c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:43.793607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:43.794299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.794583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.794860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] PATH_INFO: `/v3/projects/bc3611d64962468095a01df4b980e2f5/users/87401964de144ad0a279e8470bbe412f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.817071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3611d64962468095a01df4b980e2f5, user_id=87401964de144ad0a279e8470bbe412f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:43.818062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:43.818062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:39:43.818062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:39:43.820012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be992-fbda-482a-ba62-ece7e912d618 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:43.845978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 743/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:39:43 2022] PUT /identity/v3/projects/bc3611d64962468095a01df4b980e2f5/users/87401964de144ad0a279e8470bbe412f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:43.858268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8fb5-b1a0-4924-8eac-095e8df18785 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:43.858391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8fb5-b1a0-4924-8eac-095e8df18785 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:43.858662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8fb5-b1a0-4924-8eac-095e8df18785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:43.916764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-895d8fb5-b1a0-4924-8eac-095e8df18785 None None] MFA Rules not processed for user `87401964de144ad0a279e8470bbe412f`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:43.918006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-895d8fb5-b1a0-4924-8eac-095e8df18785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:43.998994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 759/1502] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:44.012594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.012886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.013196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.014617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 744/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Sep 1 15:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:39:44.020115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42f89-8d9b-48cd-be2e-01a77492329a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.020400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42f89-8d9b-48cd-be2e-01a77492329a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.020676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42f89-8d9b-48cd-be2e-01a77492329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.051995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:44.104897 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-0aa42f89-8d9b-48cd-be2e-01a77492329a None None] MFA Rules not processed for user `17712d9631894617aa1011ac36582543`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:44.106058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0aa42f89-8d9b-48cd-be2e-01a77492329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:44.182690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 760/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Sep 1 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:44.192214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:44.194543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:44.244538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:44.299070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935267d1-0eff-4f7a-b639-5ad8692e6ded None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:44.372639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:44.373167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.373447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.373718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.375347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:44.472429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:44.473722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:44.477245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:44.493008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 745/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:39:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:39:44.540203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeec58-094b-4c67-a2af-0981c2a5b8cd None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.540660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeec58-094b-4c67-a2af-0981c2a5b8cd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.540771 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeec58-094b-4c67-a2af-0981c2a5b8cd None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.542195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 761/1506] 10.222.0.64 () {52 vars in 830 bytes} [Thu Sep 1 15:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:39:44.545522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:44.546745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:44.644216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00c24-68b9-465a-a5a4-f0e69dada26b service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:44.736824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:44.737467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.737718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.738016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] PATH_INFO: `/v3/users/87401964de144ad0a279e8470bbe412f` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.750839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87401964de144ad0a279e8470bbe412f)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:44.751854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:44.751854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:39:44.751854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:39:44.753071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:44.762579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:44.823161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87401964de144ad0a279e8470bbe412f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:44.833175 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87401964de144ad0a279e8470bbe412f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:44.856599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87401964de144ad0a279e8470bbe412f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:44.857068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87401964de144ad0a279e8470bbe412f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:44.857591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87401964de144ad0a279e8470bbe412f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:44.879303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 746/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:39:44 2022] DELETE /identity/v3/users/87401964de144ad0a279e8470bbe412f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:44.883881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:44.884170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:44.884487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:44.953227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:44.954384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:45.030624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:45.044547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 762/1508] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:45.054319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:45.055518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:45.153463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924f12-23d5-4376-85df-1633ffdcc525 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:45.206899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:45.228289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:45.228918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:45.229184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:45.229456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:45.231113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:45.339003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:45.340433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae32c-b480-430f-bb2c-c5dbfe2a64e3 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:45.358529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 747/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:39:45.704286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:45.705529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:45.717470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56c3e-7a62-4850-87b6-de247ab25d68 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:45.818388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:45.819026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:45.819323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:45.819582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] PATH_INFO: `/v3/projects/bc3611d64962468095a01df4b980e2f5` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:45.829370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3611d64962468095a01df4b980e2f5)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:45.830415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:45.830415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:39:45.830415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:39:45.831600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:45.889259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3611d64962468095a01df4b980e2f5', 'request_id': 'req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:45.907410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3611d64962468095a01df4b980e2f5', 'request_id': 'req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:45.912325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3611d64962468095a01df4b980e2f5', 'request_id': 'req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:45.935264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] The token cache is being invalidate because project bc3611d64962468095a01df4b980e2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:39:45.935554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:45.936081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8f7844fb-0ae8-4846-8bb9-9fc14a1417a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:45.937386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 763/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:39:45 2022] DELETE /identity/v3/projects/bc3611d64962468095a01df4b980e2f5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:55.356245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=62 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:55.933289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:26.100899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:26.101500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:26.101500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:26.102832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:26.108168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7361566-e371-4d15-88a4-64805ba9d9a2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:26.108633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7361566-e371-4d15-88a4-64805ba9d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:26.108740 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7361566-e371-4d15-88a4-64805ba9d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:26.191519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f7361566-e371-4d15-88a4-64805ba9d9a2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:26.192767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f7361566-e371-4d15-88a4-64805ba9d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:26.304286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:26.456648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:26.458973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:26.574214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e92b-c455-4c70-b0cb-db9e887c96d9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:26.579606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:26.580207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:26.580486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:26.580757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:26.588656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:26.590299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e85042-67d0-4f80-94c8-ce479dbe58c3 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:26.599429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 749/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:27.445673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ea20-84b5-431b-b765-754c3ece8fc4 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:27.446289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ea20-84b5-431b-b765-754c3ece8fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:27.446289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ea20-84b5-431b-b765-754c3ece8fc4 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:27.447610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:27.452995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd665-77dc-4cac-bb1d-ce47e7354390 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:27.453430 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd665-77dc-4cac-bb1d-ce47e7354390 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:27.453549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd665-77dc-4cac-bb1d-ce47e7354390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:27.473846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7a9dd665-77dc-4cac-bb1d-ce47e7354390 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:27.475084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7a9dd665-77dc-4cac-bb1d-ce47e7354390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:27.483099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:41:27.637195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26ea20-84b5-431b-b765-754c3ece8fc4 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:27.652232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26ea20-84b5-431b-b765-754c3ece8fc4 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:27.657723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:27.658355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:27.658639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:27.658911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:27.667806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:27.669422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003cbef-442a-447f-8578-80b89b440d87 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:27.682627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 766/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:27.958316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3c2a-cd6a-4f2f-9614-1a3bdfa3bbb3 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:27.958600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3c2a-cd6a-4f2f-9614-1a3bdfa3bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:27.958869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b3c2a-cd6a-4f2f-9614-1a3bdfa3bbb3 None None] PATH_INFO: `/v3` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:27.960159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 751/1517] 10.222.0.25 () {54 vars in 925 bytes} [Thu Sep 1 15:41:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:41:27.970699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975ec9-b2ea-465f-b17d-a6ec0c13a21a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:27.971028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975ec9-b2ea-465f-b17d-a6ec0c13a21a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:27.971393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975ec9-b2ea-465f-b17d-a6ec0c13a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:28.044231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e2975ec9-b2ea-465f-b17d-a6ec0c13a21a None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:28.046040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e2975ec9-b2ea-465f-b17d-a6ec0c13a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:28.064416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:28.119598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 767/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 1 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:37.167019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616a45-d444-4141-b82a-71727ec671a5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:37.167581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616a45-d444-4141-b82a-71727ec671a5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:37.167581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68616a45-d444-4141-b82a-71727ec671a5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:37.168964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 752/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Sep 1 15:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:37.174389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9247e-c018-47b1-875c-67884a631c56 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:37.174834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9247e-c018-47b1-875c-67884a631c56 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:37.174944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9247e-c018-47b1-875c-67884a631c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:37.194606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-dbe9247e-c018-47b1-875c-67884a631c56 None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:37.195799 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dbe9247e-c018-47b1-875c-67884a631c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:37.205147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 768/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Sep 1 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:37.212551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68616a45-d444-4141-b82a-71727ec671a5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:37.225556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68616a45-d444-4141-b82a-71727ec671a5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:37.230424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142c9bc9ea44b61919dbb527904ef55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:37.231009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:37.231280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:37.231552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:37.239811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:37.241384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be549167-d71c-44d8-a9ef-30e541ed270b service placement] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:37.251186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 753/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:38.931741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded3fc-677f-4174-8341-23179a07aa92 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:38.932318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded3fc-677f-4174-8341-23179a07aa92 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:38.932318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded3fc-677f-4174-8341-23179a07aa92 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:38.933639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:38.939135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fb53-16a7-4aab-aade-2b7d5bf1fc09 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:38.939558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fb53-16a7-4aab-aade-2b7d5bf1fc09 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:38.939666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fb53-16a7-4aab-aade-2b7d5bf1fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:38.959336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a6b6fb53-16a7-4aab-aade-2b7d5bf1fc09 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:38.960522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a6b6fb53-16a7-4aab-aade-2b7d5bf1fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:38.968172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:39.124816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ded3fc-677f-4174-8341-23179a07aa92 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:39.139519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ded3fc-677f-4174-8341-23179a07aa92 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:39.145146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:39.145754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:39.146068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:39.146348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:39.154877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:39.156471 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13895c-f3b2-4861-b98b-f65072d1d03a service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:39.166024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 770/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:39.989097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2273-9c2a-4374-8f06-df946edee1cc None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:39.989626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2273-9c2a-4374-8f06-df946edee1cc None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:39.989626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d2273-9c2a-4374-8f06-df946edee1cc None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:39.990967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:39.995993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942930-959b-42a4-b7cb-1bd5dda6c32e None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:39.997994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942930-959b-42a4-b7cb-1bd5dda6c32e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:39.997994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942930-959b-42a4-b7cb-1bd5dda6c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:40.017449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d9942930-959b-42a4-b7cb-1bd5dda6c32e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:40.018746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d9942930-959b-42a4-b7cb-1bd5dda6c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:40.027498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:40.181856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d2273-9c2a-4374-8f06-df946edee1cc None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:40.196995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d2273-9c2a-4374-8f06-df946edee1cc None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:40.203394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:40.204079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:40.204270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:40.204550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:40.212860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:40.214461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426dc0b-be8a-4a98-befe-9e6a2ae7e06f service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:40.224083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 756/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:44.183268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:44.184129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:44.184327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:44.185701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:44.191146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354821ea-a42d-4eb0-8086-464f7071759a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:44.191623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354821ea-a42d-4eb0-8086-464f7071759a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:44.191719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354821ea-a42d-4eb0-8086-464f7071759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:44.212913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-354821ea-a42d-4eb0-8086-464f7071759a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:44.214180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-354821ea-a42d-4eb0-8086-464f7071759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:44.223259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:44.524858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:44.526579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:44.606076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b13919-7fa3-4439-9614-e9b8024b517e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:44.609637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:44.610264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:44.610542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:44.610814 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:44.619813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:44.621227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527a73-427c-48cc-9302-4fc4bf1f7ac6 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:44.631007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 773/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:46.561501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2188-1f5c-4e4f-9abf-8d4a3349556f None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:46.562071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2188-1f5c-4e4f-9abf-8d4a3349556f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:46.562071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2188-1f5c-4e4f-9abf-8d4a3349556f None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:46.563455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:46.568852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4350-3043-4cc7-9d63-15fce6fe0627 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:46.569287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4350-3043-4cc7-9d63-15fce6fe0627 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:46.569393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4350-3043-4cc7-9d63-15fce6fe0627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:46.589868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7abf4350-3043-4cc7-9d63-15fce6fe0627 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:46.591120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7abf4350-3043-4cc7-9d63-15fce6fe0627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:46.599812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:46.891480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2188-1f5c-4e4f-9abf-8d4a3349556f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:46.902427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2188-1f5c-4e4f-9abf-8d4a3349556f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:46.905988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:46.906664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:46.906942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:46.907215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:46.916566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:46.918017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c18a3a-42fa-49ca-a3b8-593b04118f2b service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:46.927918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 759/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:50.484673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:50.485912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:50.485912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:50.486675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:50.492600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300487-c827-4f6b-97cf-166719ed5245 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:50.493174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300487-c827-4f6b-97cf-166719ed5245 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:50.493174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300487-c827-4f6b-97cf-166719ed5245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:50.512922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-28300487-c827-4f6b-97cf-166719ed5245 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:50.514181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-28300487-c827-4f6b-97cf-166719ed5245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:50.522315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:51.078348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:51.080189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:51.146570 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:51.160425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db4ae4-37dd-40a5-a7ef-09b2819b6b0f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:51.163978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:51.164578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:51.164858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:51.165129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:51.174262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:51.175680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbf78c-889f-4640-8ff5-af571c8ae96d service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:51.184923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 776/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:53.150458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:53.151044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:53.151044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:53.152486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:53.158455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104830f-8f87-4096-856e-7efc31d1bf1c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:53.158885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104830f-8f87-4096-856e-7efc31d1bf1c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:53.158991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104830f-8f87-4096-856e-7efc31d1bf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:53.178998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5104830f-8f87-4096-856e-7efc31d1bf1c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:53.180206 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5104830f-8f87-4096-856e-7efc31d1bf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:53.188051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:53.739284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:53.740978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:53.753750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a12f-7c03-411e-b7c9-cd154137c8c3 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:53.757279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:53.757859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:53.758158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:53.758426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:53.767555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:53.769005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5ff68-9784-48bc-a5e9-4810dadb1ef9 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:53.778488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 762/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:03.174122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=11 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:03.774343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:22.737954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9510-93f0-434f-aab4-d088caace438 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.738856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9510-93f0-434f-aab4-d088caace438 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.738856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9510-93f0-434f-aab4-d088caace438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.766113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6d9b9510-93f0-434f-aab4-d088caace438 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.767464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6d9b9510-93f0-434f-aab4-d088caace438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.779730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 778/1540] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:22.784740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff074ad-cadf-4607-a9ab-9e07403fe61a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.785266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff074ad-cadf-4607-a9ab-9e07403fe61a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.785266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff074ad-cadf-4607-a9ab-9e07403fe61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.797578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.798013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.798292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.815139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-aff074ad-cadf-4607-a9ab-9e07403fe61a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.816389 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-aff074ad-cadf-4607-a9ab-9e07403fe61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.831087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.832306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.835249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 763/1541] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:22.847674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 779/1542] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:22.850707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.851009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.851270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.857556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.871769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1ee6-a1d0-4064-a3e8-0178d5fc79c6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.882536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.883164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.883448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.883774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.884532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:22.884832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.886638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.887278 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.888606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.904570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 764/1543] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:22.906994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 780/1544] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:22.911915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.927573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.928921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ccfb9-93cd-4640-a871-0ba09eabc9aa None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.940590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.941153 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.941436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.941713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.942402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:22.942708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.943724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:22.943724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:43:22.943724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:43:22.944624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.945366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95a53d-edde-44f1-a8f4-8a74cfae3622 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.956655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.957275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.957678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.957953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.958634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.959650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:22.959650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:43:22.959650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:43:22.960826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.969156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 765/1545] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:22.990424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.014962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6ab3-338b-45db-a324-7cb0b0c2431c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.027659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.028316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.029171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.029446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.030126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.032262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.044122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 781/1546] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:23.052561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.088296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 766/1547] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:23.110745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.175512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4511b-040f-4e04-b958-fa9df10fe2cc admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.262629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48730ea-b3b5-4369-9885-d62fa6548d6a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.283613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.284257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.284537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.284808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.285467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.287523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.296445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.297101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.297387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.297661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.300772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.301819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:23.301819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:43:23.301819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:43:23.303282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.324472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 782/1548] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:23.331171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.347757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844bff-2016-4974-a455-41d62701a17c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.351925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 767/1549] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:23.355965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.365644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.366308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.366589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.366867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.367526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.369146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e4be-b7ee-405c-9358-e7678adc3515 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.373129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf8773-c076-4e6f-ba75-73396a5a9b7e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.380441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.381070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.381217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 783/1550] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:23.381498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.381777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.382465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.382582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.382968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.383250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.384444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.402073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 768/1551] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:23.403018 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.419311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.420638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.424696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2a3f-0c54-46c8-af8a-6682b0ac01b7 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.429921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.430554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.431449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.431773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.432391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.438034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578ce4-7444-46c3-95c4-6aadab8f2653 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.441408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 784/1552] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.442413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.456443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550997-462c-494b-b10c-6b75c890adf2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.457600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 769/1553] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:23.459058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.459344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.459619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.471717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.472476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.472760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.473035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.473681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.475315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.491998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 785/1554] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:23.492843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.497639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.498978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.508330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d40c-50a8-4247-90f4-6f179caf41db admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.520409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.521012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.521291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.521561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] PATH_INFO: `/v3/projects/809b14886df14e6daf84a4001accda7a/users/b78f02ca2e7a4a0792e7b4e685c6f7f6/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.531773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 770/1555] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.532769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.535647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:23.543446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809b14886df14e6daf84a4001accda7a, user_id=b78f02ca2e7a4a0792e7b4e685c6f7f6, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.544862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:23.544862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:43:23.544862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:43:23.547884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.551063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25d3bd-cf8f-44cd-89f8-f58ef5307344 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.565708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 786/1556] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:23 2022] PUT /identity/v3/projects/809b14886df14e6daf84a4001accda7a/users/b78f02ca2e7a4a0792e7b4e685c6f7f6/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:23.566465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.570040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.570742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.571021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.571293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] PATH_INFO: `/v3/projects/756906a51a3243c0b88da7195704c6a4/users/95fde87d389c4154a145459f9e098390/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.603627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756906a51a3243c0b88da7195704c6a4, user_id=95fde87d389c4154a145459f9e098390, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.607641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a23e0-acfd-4473-8d2e-26443d9952e5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.636458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 771/1557] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:23 2022] PUT /identity/v3/projects/756906a51a3243c0b88da7195704c6a4/users/95fde87d389c4154a145459f9e098390/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:23.638990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48f22-dfc1-4042-8708-1a58ce902e5f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.639559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48f22-dfc1-4042-8708-1a58ce902e5f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.640085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48f22-dfc1-4042-8708-1a58ce902e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.647150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64576a29-cce6-484f-964c-a1844a0f3072 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.668225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-40f48f22-dfc1-4042-8708-1a58ce902e5f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.669484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-40f48f22-dfc1-4042-8708-1a58ce902e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.705384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.706045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.706316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.706590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.707242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:23.707550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.709177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcb39-5fcb-46df-98cc-bcd2c9ef0d1e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.721157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 787/1558] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:23.721415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:23.723635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038199-d489-42b3-9d49-49f8a75f6fa5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.724046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038199-d489-42b3-9d49-49f8a75f6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.724392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038199-d489-42b3-9d49-49f8a75f6fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.739003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 772/1559] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.740401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2479-93bd-4b13-b1bd-f8e8d55c3cf2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.740695 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2479-93bd-4b13-b1bd-f8e8d55c3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.740972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2479-93bd-4b13-b1bd-f8e8d55c3cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.751701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ca038199-d489-42b3-9d49-49f8a75f6fa5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.752959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ca038199-d489-42b3-9d49-49f8a75f6fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.760097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e3fd2479-93bd-4b13-b1bd-f8e8d55c3cf2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.761266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e3fd2479-93bd-4b13-b1bd-f8e8d55c3cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.762659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 788/1560] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.764288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621f26-b2ee-4cea-bb6b-72efe9cfbf68 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.764585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621f26-b2ee-4cea-bb6b-72efe9cfbf68 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.764859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621f26-b2ee-4cea-bb6b-72efe9cfbf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.775570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 773/1561] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.775894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac54cd-3222-4fc4-8a3a-b06f4bf3f087 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.776188 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac54cd-3222-4fc4-8a3a-b06f4bf3f087 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.776521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac54cd-3222-4fc4-8a3a-b06f4bf3f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.787207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-63621f26-b2ee-4cea-bb6b-72efe9cfbf68 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.788395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-63621f26-b2ee-4cea-bb6b-72efe9cfbf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.797185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 789/1562] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.797999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-f2ac54cd-3222-4fc4-8a3a-b06f4bf3f087 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.798551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.798754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.798987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.799251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f2ac54cd-3222-4fc4-8a3a-b06f4bf3f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.807251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 774/1563] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.808349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355d34-ed3c-46e7-856d-7949bdd6c2ab None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.808614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355d34-ed3c-46e7-856d-7949bdd6c2ab None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.808888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355d34-ed3c-46e7-856d-7949bdd6c2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.821354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.822605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.828653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b1355d34-ed3c-46e7-856d-7949bdd6c2ab None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.829835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b1355d34-ed3c-46e7-856d-7949bdd6c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.831520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 790/1564] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.832291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.837949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 775/1565] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.837949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e1de-1b6c-4629-a1a4-c0afd8fcf03b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.837949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e1de-1b6c-4629-a1a4-c0afd8fcf03b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.837949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e1de-1b6c-4629-a1a4-c0afd8fcf03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.846229 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fe7e-aa3a-45b6-ba09-5c4c141221b0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.849404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.850041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.850472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.850747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.851381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.853280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.862673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7824e1de-1b6c-4629-a1a4-c0afd8fcf03b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.864137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7824e1de-1b6c-4629-a1a4-c0afd8fcf03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.872316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 776/1566] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.873515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53f66-28e4-4acb-a606-27d68e9fd93e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.873832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53f66-28e4-4acb-a606-27d68e9fd93e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.874103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53f66-28e4-4acb-a606-27d68e9fd93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.885380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 791/1567] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:23.885380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.894201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7ed53f66-28e4-4acb-a606-27d68e9fd93e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.895428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7ed53f66-28e4-4acb-a606-27d68e9fd93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.942202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:23.948915 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83660-0327-4ee9-a7c0-03c23be0a98f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.953893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.954556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.954840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.955146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.958889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 777/1568] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.960144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979b782-91c8-4f89-8f5b-b40e18719d70 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.960436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979b782-91c8-4f89-8f5b-b40e18719d70 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.960714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979b782-91c8-4f89-8f5b-b40e18719d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.965079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.967137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.978491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 792/1569] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:23.979123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.980308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9979b782-91c8-4f89-8f5b-b40e18719d70 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.981559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9979b782-91c8-4f89-8f5b-b40e18719d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.987631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65a7e-b9cf-48b7-8003-98fee4e0365f service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.990406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 778/1570] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.992119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.992732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.993014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.993289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.995140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.995434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.995722 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.005095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.006710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8e795-b80c-48a0-8144-57cde871c47b service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.017444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 793/1571] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:24.018775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:24.018957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.019233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.019509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.020002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:24.029009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 779/1572] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:24.029270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.038939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab517-9855-4b41-b931-f3259a033358 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.042614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:24.043819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:24.044327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.045165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.045461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.045802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.046629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:24.047005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.048664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.057414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 794/1573] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:24.057414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.062518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 780/1574] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:24.063381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.068799 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c064c-7939-4ba5-af04-0d5cacd7b204 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.076490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.076986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf654e-364d-4937-b174-557868cdd7ab admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.077356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.077741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.078184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.078927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.080996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.082215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.082838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.083120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.083401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.084054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:24.084358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.086202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.101779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 781/1575] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:24.103021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.108935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 795/1576] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.108935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.118020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bceb-9588-4dd9-8a6b-656061f82fac admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.120483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861bc1b-f890-4708-99e8-2fabaa4b34df admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.124242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.125423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.125811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.126226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.126756 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.127022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:24.127435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.127844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.128360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.128763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.129558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:24.129723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.130069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.131883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.151001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 782/1577] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:24.151001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.151332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 796/1578] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:24.151332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.161471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d421-4774-4b63-81bd-ddffa8378a02 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.165240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a53d7b-ff02-42ff-b462-3c04b374174d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.170127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.170763 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.170910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.171168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.171475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.172332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.172907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.173896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.174466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.174840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.175806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:24.176271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.178790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.202244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 783/1579] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:24.202244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.208839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30823c5b-6ee0-4e59-bb97-51cc1b01aa22 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.209421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 797/1580] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.210479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.280347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.287318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.288428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.288818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.289197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.289304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fae2-f8f2-42b6-88d9-3fbc67d72d37 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.290016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.292754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.294425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.295746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.295746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.295979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.296932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.300186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.307094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 784/1581] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.310455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.324318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ed00e-a97f-4b85-a591-d7bd39bece6e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.329759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.330407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.330692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.330971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.331608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.333510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.337724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 798/1582] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.337724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.369927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 785/1583] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.371198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.421236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c8fb-e9f5-4489-ae07-77e792895d5d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.429073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.448807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a72d-1396-4f4c-9abe-250f3ec91bdc admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.454129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.454994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.454994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.455337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.455978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.458231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.497906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 786/1584] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.498864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.508463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.509106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.509394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.509676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.510660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.513493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.557144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 799/1585] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.558310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.571899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1152-ae04-4850-867e-780c945b5153 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.642697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c16d3-83a3-453a-9c4b-88b902f55919 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.656871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.657695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.657818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.658140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.658702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.659010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.659472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.660010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.660864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.661172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.664088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.665041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.678065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.697359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 800/1586] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.698426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.700473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 787/1587] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.701171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.712822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6698f-e181-4961-bf33-249f0497329f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.714263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46c4ff-d9b7-4ac1-90ad-ef4807655ee6 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.718226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.719089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.719487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.719760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.719877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.720100 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.720459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.720623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.720722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.721522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.723368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.723775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.750855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 801/1588] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 279 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.751704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.757395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 788/1589] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 284 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.758960 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.768790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af151a0-6d62-4fb7-aa67-721bc0e8efc1 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.773058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e924-87cc-47e2-bb82-49569fbf6a94 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.775367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.775999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.776280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.776557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.777996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.780737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.780976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.781697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.782156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.782635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.784375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.787047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.810852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 802/1590] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 291 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.817506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 789/1591] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.818051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.819603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.828970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826148f-d0b6-4afd-988f-84fce6d55396 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.832101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b61a03-3b36-4e4e-a5f9-edc228d66baa admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.833891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.834600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.834884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.835538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] PATH_INFO: `/v3/projects/1c03790e5d44455aaa9b5c3646b9275c/users/fa7605034d1f4b74b56d11a0af8cd77f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.837812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.838829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.839259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.839797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.840454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.842834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.857485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03790e5d44455aaa9b5c3646b9275c, user_id=fa7605034d1f4b74b56d11a0af8cd77f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.857720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 790/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.857720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.861323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.867521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d07b3d-23a5-4bf0-8c40-66a9d8ddcca5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.876491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.878978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.879317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.879594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.880259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.883666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 803/1593] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:24 2022] PUT /identity/v3/projects/1c03790e5d44455aaa9b5c3646b9275c/users/fa7605034d1f4b74b56d11a0af8cd77f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:24.884816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.885505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.914052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 791/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.914991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.935631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5ab4c-99a8-4e4a-8a70-da33f9fbe611 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.942783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.999901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db9b7c-d8b2-4d89-83cf-2dda7a82381b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.005657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.006383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.006883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.007236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.007974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.009666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.011239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.011761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.012103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.012570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.013522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.015576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.030892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 792/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.030892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.036440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 804/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.038433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.042944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a5cf-d0cb-465f-aeba-02d3128d70fc admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.048875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.049575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.049923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.050384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.051097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.052784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cedbc-dadc-41ee-9644-6610d66d9819 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.061804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871af4ce-d5ba-4a2c-95e1-c95513acc4e7 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.069605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 793/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.072170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.072581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.073050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.074770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.075623 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.076162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.076505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.077310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.079132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.100223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 805/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.100223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.100555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:25.100959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.116499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 794/1599] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:25.116499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.122780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e16e17-3cb5-42b5-95bd-bb895f18a301 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.129214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.130185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.130737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.131168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.131299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35407b88-f695-4ef3-8156-68cb7cbcfe75 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.132110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.134127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.144180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.144814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.145247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.145531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.146501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.150671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 806/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.151831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.154831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.187076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7739-4f7e-40e7-9021-0c49ebc8b732 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.190330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 795/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.195392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.205111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.205734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.206045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.206343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.206990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.208668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.218788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc594d-d11a-40eb-bd3c-feccc6dc3d06 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.231508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 807/1602] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.232366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.233347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.233988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.234293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.234826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.235520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.237125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.254225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 796/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:25.255173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.260631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72412-7be8-473a-9b91-f1cb02085477 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.272675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.273363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.275250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.275380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] PATH_INFO: `/v3/projects/2e5dd52a9b98474cac5d4691f0c63ed4/users/e2cc3d83e9e54bbe94015bad4a539ac5/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.299891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5dd52a9b98474cac5d4691f0c63ed4, user_id=e2cc3d83e9e54bbe94015bad4a539ac5, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.304750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.332214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 808/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:25 2022] PUT /identity/v3/projects/2e5dd52a9b98474cac5d4691f0c63ed4/users/e2cc3d83e9e54bbe94015bad4a539ac5/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.337666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.364712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7d153-67f5-4b94-853d-0fe260d12993 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.370391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:25.417365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1de1-41ee-4fc2-9490-f821f6277d9c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.424199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.425144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.425626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.426090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] PATH_INFO: `/v3/projects/4560b5d331e14baeaebc5b9f241b1b05/users/7ed573f138a542d38f28bf8a637fd72d/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.432959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.434565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.434867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.435148 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.449392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.453499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.459785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4560b5d331e14baeaebc5b9f241b1b05, user_id=7ed573f138a542d38f28bf8a637fd72d, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.465080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.471832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 797/1605] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:25.473320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.493779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 809/1606] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:25 2022] PUT /identity/v3/projects/4560b5d331e14baeaebc5b9f241b1b05/users/7ed573f138a542d38f28bf8a637fd72d/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.498208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b1ed2-2962-4b59-8023-ec7f8f286334 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.499731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.602482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:25.617532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c683bb-9bf7-4e08-b373-7056eb5a558a admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.625809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.626721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.627076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.627569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] PATH_INFO: `/v3/projects/9957d1f1bc934a9aa1a86bfb079d8c00/users/4f8b73a01219464e8047f8ead48e2e51/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.646746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9957d1f1bc934a9aa1a86bfb079d8c00, user_id=4f8b73a01219464e8047f8ead48e2e51, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.651152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.659825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.660613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.660839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.661414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] PATH_INFO: `/v3/projects/82b1cf91cd72478a8f6cc92fadb164d1/users/8b2edc9c874d40f7a581b63486dfc861/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.687844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 810/1607] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:25 2022] PUT /identity/v3/projects/9957d1f1bc934a9aa1a86bfb079d8c00/users/4f8b73a01219464e8047f8ead48e2e51/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.690679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.700247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b1cf91cd72478a8f6cc92fadb164d1, user_id=8b2edc9c874d40f7a581b63486dfc861, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.711846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c80783-690d-4084-8b22-d1e5906aed32 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.746426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 798/1608] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:25 2022] PUT /identity/v3/projects/82b1cf91cd72478a8f6cc92fadb164d1/users/8b2edc9c874d40f7a581b63486dfc861/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.748678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa418-e2ab-4f76-838f-e958cf930479 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.749498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa418-e2ab-4f76-838f-e958cf930479 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.749498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa418-e2ab-4f76-838f-e958cf930479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.786439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-f2caa418-e2ab-4f76-838f-e958cf930479 None None] MFA Rules not processed for user `e2cc3d83e9e54bbe94015bad4a539ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:25.788033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f2caa418-e2ab-4f76-838f-e958cf930479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.799677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1a90e-bacd-41b7-a4d1-232cc938f949 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.887357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 799/1609] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:25.889809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e06d-70a3-4ad1-ac22-b391d4080348 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.890324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e06d-70a3-4ad1-ac22-b391d4080348 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.890607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e06d-70a3-4ad1-ac22-b391d4080348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.894556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.896088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.896755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.897502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] PATH_INFO: `/v3/projects/62390a79b4f841f781ec8e5695f9fca4/users/15920d222233448d866e9cfc8e692df6/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.921884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62390a79b4f841f781ec8e5695f9fca4, user_id=15920d222233448d866e9cfc8e692df6, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.927248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5058e06d-70a3-4ad1-ac22-b391d4080348 None None] MFA Rules not processed for user `7ed573f138a542d38f28bf8a637fd72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:25.927761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2458d-9e18-43f4-85e5-75138835ec1c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.928574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5058e06d-70a3-4ad1-ac22-b391d4080348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.943141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:25.962587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 811/1610] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:25 2022] PUT /identity/v3/projects/62390a79b4f841f781ec8e5695f9fca4/users/15920d222233448d866e9cfc8e692df6/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.966135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f8bf-e051-43e7-bdb3-ae0e02a98972 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.966862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f8bf-e051-43e7-bdb3-ae0e02a98972 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.967416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f8bf-e051-43e7-bdb3-ae0e02a98972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.008138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 800/1611] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:26.009574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.010012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.010344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.024991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-0dd8f8bf-e051-43e7-bdb3-ae0e02a98972 None None] MFA Rules not processed for user `4f8b73a01219464e8047f8ead48e2e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:26.026682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0dd8f8bf-e051-43e7-bdb3-ae0e02a98972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.042614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] MFA Rules not processed for user `8b2edc9c874d40f7a581b63486dfc861`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:26.043827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.134416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:26.156348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 801/1612] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:26.157769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.164584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 812/1613] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:26.174331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.175692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.176042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.212121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:26.214128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.302496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69a54-8702-4af2-bf84-004816490d3c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.306661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 813/1614] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:26.306852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.308690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.309330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.310232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.310515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.311223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.313690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.320238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353c2f-30ee-485a-be34-690c324ebd24 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.328636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.329748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.330187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.330650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.331503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.335101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94d38f-d498-4e6e-aab4-1e16ca5e7e3d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.359435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 802/1615] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:26.360384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.402658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 814/1616] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:26.404264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.407228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.407371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.419030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 815/1617] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 15:43:26 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:26.421188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.427501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.450821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:26.493702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad5b0-09d7-4e09-9c56-9cbb34ae9099 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.612595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a4a1-d079-4c8e-a0a2-2e02e1ee9922 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.620823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.621381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.621666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.621944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.625231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.625873 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.626202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.626478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.831059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.831059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.831059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 803/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:26.831059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.831839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.831839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.831839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 816/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:26.833351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2605f03-fcd5-44c5-9dbb-a2cdc91ad701 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.836145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.849169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92921f7-0ba7-4841-a12b-0551c87a194d service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.850656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.851293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.851575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.851846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.852497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.856920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fecf-49d7-41b6-93e9-65e2dc7e2529 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.876484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.877359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.877797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.878286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.879114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.881245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.909492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 804/1620] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:26.913646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.914068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.914296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.934255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 817/1621] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:26.934255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.967286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5238e4-cc54-4708-a1cd-3f39840b1cc8 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.981166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.981841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.983436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.983610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.984376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.989129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.992817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.018053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:27.022559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 818/1622] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:27.022737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.024896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.052843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561902a-10d8-4843-b1fa-3a91a6de95b0 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.070208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.071168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.073020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.074030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.076233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.078141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.110152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 819/1623] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:27.113466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.141904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee8501-fc96-42fc-b9d4-423f7dbe9494 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.154114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.155557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.158898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.160108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] PATH_INFO: `/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.180110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.203072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 805/1624] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:27.205449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.210873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcee007f41a44a0c843d22ed0dfeb1a6, user_id=3b11d6e8b91f4fe8aa8408f84a6a1dd3, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.220394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.233798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff5916-91d4-423b-91f7-a8e1639f8fde None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.247889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.248770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 820/1625] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:27 2022] PUT /identity/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.249581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.250493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.250903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] PATH_INFO: `/v3/projects/7105faf0cf0d41948d7057e75a5bdacf/users/85f414581d1043eaa28ff07f701d6baa/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.251402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.289295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7105faf0cf0d41948d7057e75a5bdacf, user_id=85f414581d1043eaa28ff07f701d6baa, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.298334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.322535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 806/1626] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:27 2022] PUT /identity/v3/projects/7105faf0cf0d41948d7057e75a5bdacf/users/85f414581d1043eaa28ff07f701d6baa/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.324242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.467364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99550d-1141-4800-8af9-f572356d8ae5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.518531 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b30ee-faae-4c41-85d5-3a438f60332c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.526073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.527021 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.527454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.527993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.530376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.532872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.565984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 807/1627] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:27.566973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.597978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00bf0b-3c80-409e-a07b-ac958af7e5a6 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.605002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.610136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.610458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.610893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.611378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.611625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.612056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.612902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.614043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.618280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.662783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 808/1628] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:27.664604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.676895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa06f4-b9ca-48aa-8758-e80280598b46 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.693939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.694775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.695111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.695515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] PATH_INFO: `/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.699210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcee007f41a44a0c843d22ed0dfeb1a6, user_id=3b11d6e8b91f4fe8aa8408f84a6a1dd3, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.705293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.746380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 809/1629] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:27 2022] PUT /identity/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.746380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.818256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.826000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.831899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109107-d140-4b8e-91e2-abbece919347 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.847084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 821/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:27.848828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.849322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.849903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.883463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdacb10-768e-44d6-b11a-981bb017b148 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.888960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] MFA Rules not processed for user `3b11d6e8b91f4fe8aa8408f84a6a1dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:27.891363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.896038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.899519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.904912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.906590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] PATH_INFO: `/v3/projects/7105faf0cf0d41948d7057e75a5bdacf/users/85f414581d1043eaa28ff07f701d6baa/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.912457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7105faf0cf0d41948d7057e75a5bdacf, user_id=85f414581d1043eaa28ff07f701d6baa, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.917730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c416-97e5-4751-8211-c810585682f6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.947341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 810/1631] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:27 2022] PUT /identity/v3/projects/7105faf0cf0d41948d7057e75a5bdacf/users/85f414581d1043eaa28ff07f701d6baa/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.957425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.958001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.958503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.071261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] MFA Rules not processed for user `85f414581d1043eaa28ff07f701d6baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.075817 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.176832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 822/1632] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:28.189206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:28.211516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.275619 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 811/1633] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:28.288444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.351868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcf7e3-cc7b-4982-86aa-2d87c0dd2732 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.413113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab88c-0576-423f-b8b9-a225a3eecf68 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.421797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.422457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.423260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.423260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.455472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.456928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7144-f564-44d0-8ce3-1dd583e60ae3 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.458179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.458854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.459091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.459371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.485497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 812/1634] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:28.487351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612b20-ffa0-4bb9-88a0-03183ebdeef8 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.487645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612b20-ffa0-4bb9-88a0-03183ebdeef8 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.487921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612b20-ffa0-4bb9-88a0-03183ebdeef8 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.495562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 813/1635] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 15:43:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:28.504049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.504334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.504611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.560581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.566789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.591680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:28.624709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.630070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.654511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 823/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:28.763490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.767835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 814/1637] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:28.785474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573350a-94ce-454d-b294-9e4767502217 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.798095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.799631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.800166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.800755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.815519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.830576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb9082-d36d-4763-84f6-74603d22de81 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.842688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.843513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.844043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.844043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.873784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.875500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.892956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 815/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:28.968731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.969706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680043f5-b37b-4d67-98a6-ec6f39a09d2f service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.995779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 824/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:29.338912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.352699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2b1cc-92b3-4429-ad53-95a095569db9 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.365209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.365952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.366382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.366840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.471593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.501336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.503019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726a67c-868d-4ddc-b652-3938f09ae67c service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.535911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 816/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:30.060181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1c828-a1d0-4796-9e13-7595d1494626 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.060650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1c828-a1d0-4796-9e13-7595d1494626 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.060801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1c828-a1d0-4796-9e13-7595d1494626 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.062668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 825/1641] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 15:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:30.075895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df4c8-c711-4e94-992f-772043c1acaf None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.076654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df4c8-c711-4e94-992f-772043c1acaf None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.077294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df4c8-c711-4e94-992f-772043c1acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.116673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-433df4c8-c711-4e94-992f-772043c1acaf None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:30.118078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-433df4c8-c711-4e94-992f-772043c1acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:30.156917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 817/1642] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:30.162894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70fae-4cb7-4056-ab8e-266ad7943268 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.163357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70fae-4cb7-4056-ab8e-266ad7943268 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.163732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70fae-4cb7-4056-ab8e-266ad7943268 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.165630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 826/1643] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 15:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:43:30.172268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.172699 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.173070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.226015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:30.228307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:30.264112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 818/1644] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:30.272302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70fae-4cb7-4056-ab8e-266ad7943268 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:30.303718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70fae-4cb7-4056-ab8e-266ad7943268 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.311354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.313025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.313412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.313786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.330530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.333766 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49f52-088d-4880-be20-450aa8ddeecd service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.369639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 827/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:34.354809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:34.528104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082c578-3d9c-4213-aa2a-e1642665d67c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:34.543213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:34.544227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.544516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.544839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] PATH_INFO: `/v3/users/e2cc3d83e9e54bbe94015bad4a539ac5` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.548700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cc3d83e9e54bbe94015bad4a539ac5)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:34.552130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:34.656330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cc3d83e9e54bbe94015bad4a539ac5'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.676995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cc3d83e9e54bbe94015bad4a539ac5'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.711541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cc3d83e9e54bbe94015bad4a539ac5'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.711541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cc3d83e9e54bbe94015bad4a539ac5'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.711541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cc3d83e9e54bbe94015bad4a539ac5'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.736816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 819/1646] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:34 2022] DELETE /identity/v3/users/e2cc3d83e9e54bbe94015bad4a539ac5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:34.739678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.740118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.740472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.775301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:34.777267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.946843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 828/1647] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:35.070893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.072627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.205937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3e7e-9ade-4aca-8ae4-c696ede337c0 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.238860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.242883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.243927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.244320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.244805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.245271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.256708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:35.259736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.262179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232820c9-3708-4d8b-8bd0-5c869f640f28 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:35.273235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98005e3b-37d5-47df-b2cb-165503932dcd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.283917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 820/1648] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:35.288970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.289773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.290178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.290798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] PATH_INFO: `/v3/users/8b2edc9c874d40f7a581b63486dfc861` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.292943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2edc9c874d40f7a581b63486dfc861)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.294762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: WARNING py.warnings [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:35.294762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: warnings.warn(msg) Sep 01 15:43:35.294762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: Sep 01 15:43:35.296209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:35.480047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2edc9c874d40f7a581b63486dfc861'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.503767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2edc9c874d40f7a581b63486dfc861'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.503767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2edc9c874d40f7a581b63486dfc861'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.553054 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:35.566041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2edc9c874d40f7a581b63486dfc861'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.567152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2edc9c874d40f7a581b63486dfc861'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.613691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 829/1649] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:35 2022] DELETE /identity/v3/users/8b2edc9c874d40f7a581b63486dfc861 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:35.623568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7118a-a85d-4e77-a4fa-fc01105b6d6d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.626060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7118a-a85d-4e77-a4fa-fc01105b6d6d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.626454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7118a-a85d-4e77-a4fa-fc01105b6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.667565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-bae7118a-a85d-4e77-a4fa-fc01105b6d6d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:35.669005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bae7118a-a85d-4e77-a4fa-fc01105b6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.846709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 821/1650] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:35.957034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.959728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.131978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e140b1-6286-4805-bb4f-1b5d70fad36f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.142382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.144544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.146071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.146421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.185938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.187651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.213624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 830/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:36.565562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.566110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.566534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.610399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] MFA Rules not processed for user `95fde87d389c4154a145459f9e098390`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:36.611984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.745077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 822/1652] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:36.768683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.770591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.916866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234aa46-067b-4dec-a1e3-74aca39a9d33 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.928072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.928072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.928072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.928072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.942279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.944726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.960549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 831/1653] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:37.013183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.014858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.047906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb377-a25a-41bd-91a7-a7817496eac0 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.059989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.061269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.061557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.061836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] PATH_INFO: `/v3/projects/2e5dd52a9b98474cac5d4691f0c63ed4` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.067753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5dd52a9b98474cac5d4691f0c63ed4)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.071526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: WARNING py.warnings [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:43:37.071526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: warnings.warn(msg) Sep 01 15:43:37.071526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: Sep 01 15:43:37.083190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.253485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5dd52a9b98474cac5d4691f0c63ed4', 'request_id': 'req-914aa545-181c-44b6-92dc-2654033cb7ce'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.268829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5dd52a9b98474cac5d4691f0c63ed4', 'request_id': 'req-914aa545-181c-44b6-92dc-2654033cb7ce'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.312937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5dd52a9b98474cac5d4691f0c63ed4', 'request_id': 'req-914aa545-181c-44b6-92dc-2654033cb7ce'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.337050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] The token cache is being invalidate because project 2e5dd52a9b98474cac5d4691f0c63ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:37.337594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.338503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-914aa545-181c-44b6-92dc-2654033cb7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.348617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 823/1654] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:37 2022] DELETE /identity/v3/projects/2e5dd52a9b98474cac5d4691f0c63ed4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.352710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.367445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb93e5-696e-402f-8edf-f48f374e6ce6 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.597789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.598561 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.600585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.601080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] PATH_INFO: `/v3/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.609616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b11d6e8b91f4fe8aa8408f84a6a1dd3)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.615552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.676337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:37.828034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b11d6e8b91f4fe8aa8408f84a6a1dd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.846356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b11d6e8b91f4fe8aa8408f84a6a1dd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.852278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b11d6e8b91f4fe8aa8408f84a6a1dd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.897379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b11d6e8b91f4fe8aa8408f84a6a1dd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.898148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-35c0ce08-bdc1-453b-8278-a56aafc1bdf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b11d6e8b91f4fe8aa8408f84a6a1dd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.927384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 832/1655] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:37 2022] DELETE /identity/v3/users/3b11d6e8b91f4fe8aa8408f84a6a1dd3 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:38.352842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.353902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.355596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.415460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:38.445401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] MFA Rules not processed for user `b78f02ca2e7a4a0792e7b4e685c6f7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:38.448731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.639040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 824/1656] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.648933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae4afd-620c-433e-82df-3255329903db None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.649466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae4afd-620c-433e-82df-3255329903db None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.649572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae4afd-620c-433e-82df-3255329903db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.686500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-38ae4afd-620c-433e-82df-3255329903db None None] MFA Rules not processed for user `b78f02ca2e7a4a0792e7b4e685c6f7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:38.690918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-38ae4afd-620c-433e-82df-3255329903db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.709091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 833/1657] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.720961 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.723802 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.853568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae4afd-620c-433e-82df-3255329903db None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.856964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-38ae4afd-620c-433e-82df-3255329903db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.926387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355acec-c7f3-438d-bba8-e0a01622ddc0 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.934070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.934741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.935022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.935293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.960581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.964685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da80ae-888d-4562-9aa5-c661f57bec47 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.978725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 825/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:39.047222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae4afd-620c-433e-82df-3255329903db None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.057339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.062533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.064234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.064744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] PATH_INFO: `/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.067513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcee007f41a44a0c843d22ed0dfeb1a6)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.074490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.217062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcee007f41a44a0c843d22ed0dfeb1a6', 'request_id': 'req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.240698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcee007f41a44a0c843d22ed0dfeb1a6', 'request_id': 'req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.279847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcee007f41a44a0c843d22ed0dfeb1a6', 'request_id': 'req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.320190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] The token cache is being invalidate because project fcee007f41a44a0c843d22ed0dfeb1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:39.321106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.322907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-023c7ecd-21ac-49ed-a0bb-c08fbc60b7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.329279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 834/1659] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:38 2022] DELETE /identity/v3/projects/fcee007f41a44a0c843d22ed0dfeb1a6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:39.334158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.334458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.334741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.393663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:39.398502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.610260 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 826/1660] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:39.619618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.620564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.620846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.681467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:39.682539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.708121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 835/1661] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:39.713017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.740956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de1ea1-b06a-43f5-beac-adec8a935a61 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.767458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.768094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.768512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.768803 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.773036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:39.773657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.775832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.823233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 827/1662] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:39.823592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.841994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39608b-c38b-4b02-93dd-6a6832d538fc None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.860521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.861346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.861707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.862064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.862964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.865255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.884762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:39.930674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 836/1663] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:39.935918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.950786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eadf2-a7c1-40f9-9dd1-c32aebcb0ada admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.985332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:39.987588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.989630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.142916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.145408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.146535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.147536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.149233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.154806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.188108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118bf9-9fa6-432b-aa17-e071cc61d255 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.199097 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.200617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.201026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.201255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 828/1664] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:40.202395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] PATH_INFO: `/v3/projects/82b1cf91cd72478a8f6cc92fadb164d1` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.205346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b1cf91cd72478a8f6cc92fadb164d1)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.206572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.207532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.241409 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea780-ec56-4c87-af2f-7d55dd06edad admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.253700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.255726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.255726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.256173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.257110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.259167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.280603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 829/1665] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:40.281692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.295631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204259bb-6ca0-4e58-afc4-56e929894728 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.303287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.304382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.304674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.304952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.315784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.315784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.328478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 830/1666] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:40.332947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.351198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af12925-b0e8-4c34-afd0-a2c7f9c474c2 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.373748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b1cf91cd72478a8f6cc92fadb164d1', 'request_id': 'req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.405804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b1cf91cd72478a8f6cc92fadb164d1', 'request_id': 'req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.436392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b1cf91cd72478a8f6cc92fadb164d1', 'request_id': 'req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.473753 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] The token cache is being invalidate because project 82b1cf91cd72478a8f6cc92fadb164d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:40.478339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.479690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.487669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 837/1667] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:39 2022] DELETE /identity/v3/projects/82b1cf91cd72478a8f6cc92fadb164d1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:40.489505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.494091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.497549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.498399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.498686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.498968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] PATH_INFO: `/v3/projects/de2b1d9026c248f1a43064f68eb779f0/users/ca61cea037b840359fd0270f5ff54b35/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.524770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2b1d9026c248f1a43064f68eb779f0, user_id=ca61cea037b840359fd0270f5ff54b35, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.527721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076f782-a26c-4e7a-8f82-816ea4bb98fb admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.532373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f1ef-2b6a-496b-8a34-a57cf537cd92 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.546754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.547590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.547892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.548170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] PATH_INFO: `/v3/users/4f8b73a01219464e8047f8ead48e2e51` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.555237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8b73a01219464e8047f8ead48e2e51)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.562156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.562836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 831/1668] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:40 2022] PUT /identity/v3/projects/de2b1d9026c248f1a43064f68eb779f0/users/ca61cea037b840359fd0270f5ff54b35/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.565113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3559-492e-44d3-a04e-81861794cc10 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.565315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3559-492e-44d3-a04e-81861794cc10 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.565557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3559-492e-44d3-a04e-81861794cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.598714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e6dc3559-492e-44d3-a04e-81861794cc10 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.600229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e6dc3559-492e-44d3-a04e-81861794cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.762991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8b73a01219464e8047f8ead48e2e51'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.793856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8b73a01219464e8047f8ead48e2e51'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.795579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8b73a01219464e8047f8ead48e2e51'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.812042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 832/1669] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:40.815547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35ad4-4cc4-4606-9e55-1b08463a4f02 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.815845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35ad4-4cc4-4606-9e55-1b08463a4f02 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.816128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35ad4-4cc4-4606-9e55-1b08463a4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.836350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.846181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8b73a01219464e8047f8ead48e2e51'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.850404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a57e64c9-f28a-44f7-b45f-d847c184a707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8b73a01219464e8047f8ead48e2e51'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.861746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.895407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0ac35ad4-4cc4-4606-9e55-1b08463a4f02 None None] MFA Rules not processed for user `ca61cea037b840359fd0270f5ff54b35`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.899813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 838/1670] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:40 2022] DELETE /identity/v3/users/4f8b73a01219464e8047f8ead48e2e51 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.899813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.899813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.899813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.900555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0ac35ad4-4cc4-4606-9e55-1b08463a4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.965838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.967283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.080569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 833/1671] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.082692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.083248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.083704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.118295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 839/1672] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.118295 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.119669 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.122823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.135223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.145408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b5e6-0598-4c24-95b1-f88bf43ca988 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.158373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.158953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.159224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.159486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.160141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.162093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.175152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 834/1673] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.178120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.212690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd400ad-9a54-4e31-954a-14f539169e6b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.223092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.225437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 840/1674] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.226482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.227331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.228033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.228921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:41.230512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.245843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.263666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d60ec-87b8-427c-a16a-65a9571ea813 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.313176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 835/1675] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:41.318397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.321066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.321479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.328328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 836/1676] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 15:43:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:41.329307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.343677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.470932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfcda4-6328-44c5-a595-37e1ad31718b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.488045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.491091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.491525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.491875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.508769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.513456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.578667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a67c-bcd5-4f6a-bd93-b7d74c418783 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.580973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 841/1677] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/users => generated 296 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.586185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.589289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.593033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.593156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.596772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.636048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46eafa-3ee5-4e40-a48e-6697a1224c55 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.648584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.650214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.651179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.651744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.652657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.653442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.656353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.662294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f51c3a-385e-451e-98fa-86adda67b541 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.707066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 837/1678] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:41.708578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.709543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.709934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.752098 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 842/1679] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.753913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.825289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.835811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.888504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.015223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159541a8-565f-4403-afd4-8bfbe36ee464 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.024207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.025347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.025917 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.026380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.027828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.031623 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db0dc2-f273-4e75-8284-ebcfd7c6245f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.044768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 838/1680] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.045751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.091643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06dedb-eea8-4ff0-a486-9a8b352dfc9d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.099728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 843/1681] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.105811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.107107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.107505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.107633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.108277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.110466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.112152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.112667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.113091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.141237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] MFA Rules not processed for user `95fde87d389c4154a145459f9e098390`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:42.144654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.152176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.179106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 839/1682] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:42.179106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.211764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7f01-0bbf-4570-8584-8008b535da6d admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.238125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.239070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.239349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.239623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] PATH_INFO: `/v3/projects/a288db55f4b34f7781f19fbc8966fea0/users/f6bd7ec19355451a8a21cd84f049811a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.271029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a288db55f4b34f7781f19fbc8966fea0, user_id=f6bd7ec19355451a8a21cd84f049811a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.273718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.315633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 840/1683] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:42 2022] PUT /identity/v3/projects/a288db55f4b34f7781f19fbc8966fea0/users/f6bd7ec19355451a8a21cd84f049811a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:42.321857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.352752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 844/1684] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.352752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.372677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd621-a801-4a58-b7a4-7c3896a2777b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.454125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c99957-8d39-4176-9945-443f3c4e95b3 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.459293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.459913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.460195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.460471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.470474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.471998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.488805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 841/1685] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:42.488805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.585667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.587234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.588852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.589083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.591717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.600136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.625225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 845/1686] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.626233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.638015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274d25-5214-4ed6-84e2-e2a750f65e32 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.639572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d961e-5e9e-48a3-88dc-2d092b360c63 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.644598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.645755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.646074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.646183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.646350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.647085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.647197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.647593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.648087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.649234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.649692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.652243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.672512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 846/1687] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.673218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 842/1688] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.673674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.675512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.689908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde53a1-2d24-4560-a632-8e036b4103e5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.692941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa274-bf56-4797-ad38-29a2346c4f65 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.698487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.699507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.700073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.700558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] PATH_INFO: `/v3/projects/a288db55f4b34f7781f19fbc8966fea0/users/f6bd7ec19355451a8a21cd84f049811a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.700823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.701747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.702288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.702599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] PATH_INFO: `/v3/projects/6ee398f5fd59454784cb262d5968d163/users/970dd06784be4bf3823464f27f88da26/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.704199 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a288db55f4b34f7781f19fbc8966fea0, user_id=f6bd7ec19355451a8a21cd84f049811a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.709688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404a73-7426-4607-8ea4-a26ff68bb7c3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.735846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 843/1689] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:42 2022] PUT /identity/v3/projects/a288db55f4b34f7781f19fbc8966fea0/users/f6bd7ec19355451a8a21cd84f049811a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:42.740042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee398f5fd59454784cb262d5968d163, user_id=970dd06784be4bf3823464f27f88da26, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.742626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.742626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.742840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.752478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3af8d7-c825-4f60-bb7e-3c6a2ccb6aa9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.780186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 847/1690] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:42 2022] PUT /identity/v3/projects/6ee398f5fd59454784cb262d5968d163/users/970dd06784be4bf3823464f27f88da26/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:42.797911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcf50-a83c-4f35-9a91-e5e0a459a3b6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.799075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcf50-a83c-4f35-9a91-e5e0a459a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.799393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcf50-a83c-4f35-9a91-e5e0a459a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.811205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] MFA Rules not processed for user `f6bd7ec19355451a8a21cd84f049811a`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:42.815005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.839673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-33ffcf50-a83c-4f35-9a91-e5e0a459a3b6 None None] MFA Rules not processed for user `970dd06784be4bf3823464f27f88da26`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:42.841737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-33ffcf50-a83c-4f35-9a91-e5e0a459a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.877021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.898718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.948687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 844/1691] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.958843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 848/1692] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.961509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.968062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.112857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300dc66-382c-4b59-a8d8-13ed8afee77c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.118458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.119272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.119966 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.120345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.135981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.139762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11bd60-9ebd-4a12-9183-76a2478ed5a4 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.157668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 845/1693] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:43.252130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.252434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.252715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.255843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 849/1694] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 15:43:43 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:43.265023 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.265207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.265410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.310390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:43.311211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.508520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 846/1695] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:43.521017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.523453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.562101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5239c1f-9cae-40b2-b976-7b72c422d13e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.567380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.568006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.568485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.568757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.593240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.596425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.651148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 850/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:44.018279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.038846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95856-caef-4c15-9cbd-b90562e6a014 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.058045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6bd7ec19355451a8a21cd84f049811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288db55f4b34f7781f19fbc8966fea0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.058919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.059298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.059587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.070221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:44.070382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.078884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.107886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.109392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.120362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 847/1697] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:44.121323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.123933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.294490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef5f8-aeaf-41e1-a984-7dfcd577e492 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.299989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.300956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.301408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.301858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] PATH_INFO: `/v3/projects/9957d1f1bc934a9aa1a86bfb079d8c00` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.303764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9957d1f1bc934a9aa1a86bfb079d8c00)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.305476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ea07-992e-4859-bb1b-cfc4a22b49f4 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.308007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.324163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.324844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.325224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.325443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.341312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.342946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.360574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:44.382457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 851/1698] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:44.383439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.409081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7234-912c-4768-adca-ac590fbaedb0 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.451774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9957d1f1bc934a9aa1a86bfb079d8c00', 'request_id': 'req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.471211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9957d1f1bc934a9aa1a86bfb079d8c00', 'request_id': 'req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.497655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9957d1f1bc934a9aa1a86bfb079d8c00', 'request_id': 'req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.498614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6bd7ec19355451a8a21cd84f049811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288db55f4b34f7781f19fbc8966fea0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.499543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.499903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.500243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.501283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.503555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeacbd1-c6be-4d9e-a42c-3b745b86e125 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.521393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] The token cache is being invalidate because project 9957d1f1bc934a9aa1a86bfb079d8c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:44.522013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.522972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.526688 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 848/1699] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:44 2022] DELETE /identity/v3/projects/9957d1f1bc934a9aa1a86bfb079d8c00 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:44.527837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.547154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.576726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 852/1700] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:44 2022] POST /identity/v3/projects => generated 354 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:44.579682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.582220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.582588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.633730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:44.636018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.667236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e03e-a285-4fb8-9cc2-11b951fd59c6 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.676992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:44.831679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 853/1701] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:44.832460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.835587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.845303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142c9bc9ea44b61919dbb527904ef55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.847255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.847549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.847820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.856374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.899429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.910333 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454abe5-3641-4663-9d36-33e21f41ba44 service placement] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.952993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 849/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:44.975542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ab8b-92dc-44bc-a521-4d47d5c1e8bc None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.975829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ab8b-92dc-44bc-a521-4d47d5c1e8bc None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.976112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916ab8b-92dc-44bc-a521-4d47d5c1e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.061238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a95b6a-9050-44ab-8896-d73ab0a4b7ef None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.082359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-4916ab8b-92dc-44bc-a521-4d47d5c1e8bc None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.085296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6bd7ec19355451a8a21cd84f049811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288db55f4b34f7781f19fbc8966fea0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.086998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4916ab8b-92dc-44bc-a521-4d47d5c1e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.088243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.088758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.091025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.091959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:45.094972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.099504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2321cf-7ad8-4117-980d-a4eff119a0f2 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.127673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 850/1703] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:45.133133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.133528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.133906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.155988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 854/1704] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:45.162307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.163883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.164575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.173245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] MFA Rules not processed for user `fa7605034d1f4b74b56d11a0af8cd77f`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.174816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.265946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:45.277521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] MFA Rules not processed for user `b78f02ca2e7a4a0792e7b4e685c6f7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.278856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.535213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 851/1705] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:45.537606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.575696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 855/1706] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:45.576988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.579955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ce53d-f8d4-416a-ae75-2596ab5e182a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.598698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.602743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.603165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.603454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.604232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:45.604496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.617360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76214df1-9062-47dd-b97b-25b2c9c70c9d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.617490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23030ea6-1ca6-479c-be88-ce47b9f7ed79 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.631644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6bd7ec19355451a8a21cd84f049811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a288db55f4b34f7781f19fbc8966fea0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.632554 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.632853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.633201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] PATH_INFO: `/v3/projects/2616bc87e6864fd0974ef67144173c4d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.635833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2616bc87e6864fd0974ef67144173c4d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.639662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.683398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 852/1707] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:45.684920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.685215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.685498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.744773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] MFA Rules not processed for user `fa7605034d1f4b74b56d11a0af8cd77f`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.746044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.765170 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 853/1708] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:45.776676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.809569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738e261-44d9-46cc-aaf8-5d8376a1d5cb None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.865069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2616bc87e6864fd0974ef67144173c4d', 'request_id': 'req-96cc1906-f724-4f01-aeb5-4b52aff99218'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.884723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2616bc87e6864fd0974ef67144173c4d', 'request_id': 'req-96cc1906-f724-4f01-aeb5-4b52aff99218'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.903901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:45.914319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2616bc87e6864fd0974ef67144173c4d', 'request_id': 'req-96cc1906-f724-4f01-aeb5-4b52aff99218'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.944773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] The token cache is being invalidate because project 2616bc87e6864fd0974ef67144173c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:45.945064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.945751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.954678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 856/1709] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:45 2022] DELETE /identity/v3/projects/2616bc87e6864fd0974ef67144173c4d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:45.954678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.954678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.078364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.079015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.086627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.087246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.087702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.096306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.201481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 854/1710] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/projects => generated 383 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:46.212243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:46.223108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.346851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc1906-f724-4f01-aeb5-4b52aff99218 tempest-VolumeQuotaClassesTest-833926861 tempest-VolumeQuotaClassesTest-833926861-project-admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:46.458556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79880-cf1f-438e-bf26-0b7d08f72718 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:46.498244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.504753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.505262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.505733 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.510529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.517617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.638672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 855/1711] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:46 2022] POST /identity/v3/users => generated 292 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:46.648478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:46.662984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.713270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.714051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.714340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.714505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.722883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb53b-84ae-44e4-a729-b453a4b2f791 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:46.733844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.745276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.746096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.746482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.746895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] PATH_INFO: `/v3/users/ca61cea037b840359fd0270f5ff54b35` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.748314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca61cea037b840359fd0270f5ff54b35)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.753826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.805337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:46.925215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca61cea037b840359fd0270f5ff54b35'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:46.941632 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.946949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.951818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca61cea037b840359fd0270f5ff54b35'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:46.986615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 857/1712] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1034 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:46.992436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:47.001512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca61cea037b840359fd0270f5ff54b35'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:47.006678 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca61cea037b840359fd0270f5ff54b35'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:47.009012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1f04b97e-7d60-4157-b179-57a3d988d49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca61cea037b840359fd0270f5ff54b35'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:47.033489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a95a6-59a3-4faf-872d-1f7a59fa5c23 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:47.062912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 856/1713] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:46 2022] DELETE /identity/v3/users/ca61cea037b840359fd0270f5ff54b35 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:47.068341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:47.070898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.071259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.071881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.073254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.073788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.074652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:47.075657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.080797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78194c-41f5-44ae-80b5-6ab150197db0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:47.115304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 858/1714] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:47.117586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.117876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.120837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.177345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] MFA Rules not processed for user `15920d222233448d866e9cfc8e692df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:47.179893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:47.197536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:47.205129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:47.230252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:47.300824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 857/1715] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:47.302039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:47.305892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:47.394226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 859/1716] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:47.410081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:47.411614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:47.585816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec83f2-9d5d-4873-84d9-a5e0a3a42e16 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:47.605789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:47.607013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.607658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.607939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.625390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d48411-0696-4dec-803a-5e33e7185c8a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:47.628717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:47.630465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:47.657195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:47.659376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 860/1717] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:47.660453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.662885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.663183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.665364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:47.669360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9c36-f109-4cc9-b55a-2bacc7fe3508 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:47.722062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 858/1718] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:47.723569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:47.737400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aff73-cf4a-46fb-b649-f49fbf79e7b5 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:47.747328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:47.748080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.748374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.750224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] PATH_INFO: `/v3/projects/8a9553d2af814479ae1e2e8890e53d6e/users/6c73abf8ae2e425ab4dda14fba94682d/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.787122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9553d2af814479ae1e2e8890e53d6e, user_id=6c73abf8ae2e425ab4dda14fba94682d, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:47.797876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:47.846039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 861/1719] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:47 2022] PUT /identity/v3/projects/8a9553d2af814479ae1e2e8890e53d6e/users/6c73abf8ae2e425ab4dda14fba94682d/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:47.857670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:47.857893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:47.858197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:47.967008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] MFA Rules not processed for user `6c73abf8ae2e425ab4dda14fba94682d`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:47.973290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:47.996262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:48.273210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:48.275878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:48.334662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 859/1720] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:48.340796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:48.529879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1dac1-50b1-483a-9542-5be268c75420 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:48.539759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:48.541152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:48.541809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:48.542580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:48.567785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21651ed2-e8e0-4632-a418-28991d4744ca None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:48.578171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:48.578879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:48.579155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:48.579425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:48.581012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:48.582982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:48.591695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:48.698323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 860/1721] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:48 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:48.699575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:48.705416 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:48.751697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:48.755729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:48.787673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 862/1722] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:48.795817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:48.833000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b558a-9ce7-4de1-9f3d-8def8608b54f service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:48.902375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd162-3e04-4101-b75c-6ad622029a10 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:48.916554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:48.917173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:48.923256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:48.923655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] PATH_INFO: `/v3/projects/de2b1d9026c248f1a43064f68eb779f0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:48.925005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2b1d9026c248f1a43064f68eb779f0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:48.927136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:49.058179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:49.087266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2b1d9026c248f1a43064f68eb779f0', 'request_id': 'req-68293c1e-2635-4154-b590-1478a580ea34'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.097386 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2b1d9026c248f1a43064f68eb779f0', 'request_id': 'req-68293c1e-2635-4154-b590-1478a580ea34'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.100082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:49.103232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:49.103913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:49.104221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:49.104925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:49.106985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:49.127236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2b1d9026c248f1a43064f68eb779f0', 'request_id': 'req-68293c1e-2635-4154-b590-1478a580ea34'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.232197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] The token cache is being invalidate because project de2b1d9026c248f1a43064f68eb779f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:49.233942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.236040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.241199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 863/1724] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:48 2022] POST /identity/v3/users => generated 300 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:49.243841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 861/1724] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:48 2022] DELETE /identity/v3/projects/de2b1d9026c248f1a43064f68eb779f0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:49.244871 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:49.245917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:49.248739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:49.248883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:49.310955 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4085f2-bd18-44ce-8bdb-c97ec3259ff9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:49.414575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68293c1e-2635-4154-b590-1478a580ea34 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:49.437108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:49.438443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:49.438727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:49.444638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] PATH_INFO: `/v3/users/f6bd7ec19355451a8a21cd84f049811a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:49.450969 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bd7ec19355451a8a21cd84f049811a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:49.460887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:49.504218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:49.520148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:49.523181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:49.525317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:49.527396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:49.532770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:49.598898 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 864/1725] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:49.600019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:49.645030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0592d5-54d7-4542-ad1f-a5938e7a3b29 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:49.674070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69078063-1244-4dab-866a-472f49987329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:49.675901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078063-1244-4dab-866a-472f49987329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:49.678850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078063-1244-4dab-866a-472f49987329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:49.679683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69078063-1244-4dab-866a-472f49987329 admin admin] PATH_INFO: `/v3/projects/276654b415bf4c55a1bedd9e5c862805/users/9ae0745696d84a519bb505eab0c3b5c6/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:49.703761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bd7ec19355451a8a21cd84f049811a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.741739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bd7ec19355451a8a21cd84f049811a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.793869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69078063-1244-4dab-866a-472f49987329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276654b415bf4c55a1bedd9e5c862805, user_id=9ae0745696d84a519bb505eab0c3b5c6, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:49.803741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69078063-1244-4dab-866a-472f49987329 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:49.814404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bd7ec19355451a8a21cd84f049811a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.817489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bd7ec19355451a8a21cd84f049811a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.822613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bd7ec19355451a8a21cd84f049811a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:49.902786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 862/1726] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:49 2022] DELETE /identity/v3/users/f6bd7ec19355451a8a21cd84f049811a => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:49.908852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 865/1727] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:49 2022] PUT /identity/v3/projects/276654b415bf4c55a1bedd9e5c862805/users/9ae0745696d84a519bb505eab0c3b5c6/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:49.910139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:49.912715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.082466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69078063-1244-4dab-866a-472f49987329 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.084731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-69078063-1244-4dab-866a-472f49987329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.085280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:50.188187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:50.242113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e58f-26b6-4c55-b3a7-cfe18806f11f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.263327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.268518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.268822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.269107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.275084 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.284156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f662a-b855-48ba-8149-9994a871805b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.292613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69078063-1244-4dab-866a-472f49987329 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.299556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.300132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.300425 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.300762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] PATH_INFO: `/v3/users/7ed573f138a542d38f28bf8a637fd72d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.303457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed573f138a542d38f28bf8a637fd72d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.307448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.326650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 863/1728] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:50.328316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fc76-fb16-4b23-ab1e-e957f5c22aaa None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.328605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fc76-fb16-4b23-ab1e-e957f5c22aaa None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.328888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fc76-fb16-4b23-ab1e-e957f5c22aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.424235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed573f138a542d38f28bf8a637fd72d'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.443099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed573f138a542d38f28bf8a637fd72d'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.445301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed573f138a542d38f28bf8a637fd72d'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.488464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-db71fc76-fb16-4b23-ab1e-e957f5c22aaa None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:50.490454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed573f138a542d38f28bf8a637fd72d'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.491364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-db71fc76-fb16-4b23-ab1e-e957f5c22aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.493255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed573f138a542d38f28bf8a637fd72d'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.581336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 866/1729] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:50 2022] DELETE /identity/v3/users/7ed573f138a542d38f28bf8a637fd72d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:50.587658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.591075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.705288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 864/1730] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:50.707214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386370d2-c104-4352-a961-ff47bc01deae None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.707723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386370d2-c104-4352-a961-ff47bc01deae None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.708209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386370d2-c104-4352-a961-ff47bc01deae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.758012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-386370d2-c104-4352-a961-ff47bc01deae None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:50.760559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-386370d2-c104-4352-a961-ff47bc01deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.866278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335605c7-9d46-483d-a17d-71da84d14c26 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.870009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 865/1731] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:50.883387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.884816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.885249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.886275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] PATH_INFO: `/v3/projects/276654b415bf4c55a1bedd9e5c862805/users/9ae0745696d84a519bb505eab0c3b5c6/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.893902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] RBAC: Authorizing `identity:create_grant(project_id=276654b415bf4c55a1bedd9e5c862805, user_id=9ae0745696d84a519bb505eab0c3b5c6, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.907020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386370d2-c104-4352-a961-ff47bc01deae None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.908496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-386370d2-c104-4352-a961-ff47bc01deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.914722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.964532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 867/1732] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:50 2022] PUT /identity/v3/projects/276654b415bf4c55a1bedd9e5c862805/users/9ae0745696d84a519bb505eab0c3b5c6/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:50.965377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.983060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.069607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386370d2-c104-4352-a961-ff47bc01deae None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.083476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:51.211910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:51.280597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.283569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.295957 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.297473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.384038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4eea-f8e1-4959-9c5e-19314b4b495a admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.419595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.420450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.422947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.425292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.513501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.515329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce4644-8ebe-4151-b56f-c527c2f513d2 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.548257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 866/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:51.551074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.551362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.551638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.598020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] MFA Rules not processed for user `9ae0745696d84a519bb505eab0c3b5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:51.599608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.601430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.615495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.638265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 868/1734] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:43:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:43:51.639160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.644823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.684747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb757ee-6b06-4ba2-b7da-0c8f123ca770 service swift] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.689869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.691251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.691516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.691804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] PATH_INFO: `/v3/users/970dd06784be4bf3823464f27f88da26` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.694122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970dd06784be4bf3823464f27f88da26)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.696191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.763617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 867/1735] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:51.764602 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.776883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.816093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0a01-942b-4cbf-995b-e4543db4b219 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.829422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.830130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.830466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.830795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] PATH_INFO: `/v3/projects/a288db55f4b34f7781f19fbc8966fea0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.832639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a288db55f4b34f7781f19fbc8966fea0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.836845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.846092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970dd06784be4bf3823464f27f88da26'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.857344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970dd06784be4bf3823464f27f88da26'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.858358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970dd06784be4bf3823464f27f88da26'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.884968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970dd06784be4bf3823464f27f88da26'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.885915 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970dd06784be4bf3823464f27f88da26'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.912985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 869/1736] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/users/970dd06784be4bf3823464f27f88da26 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:51.915223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.922170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.971833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.004115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a288db55f4b34f7781f19fbc8966fea0', 'request_id': 'req-64dd7f8c-2312-4d0f-8f25-051f807656c8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.052168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a288db55f4b34f7781f19fbc8966fea0', 'request_id': 'req-64dd7f8c-2312-4d0f-8f25-051f807656c8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.060058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.084925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a288db55f4b34f7781f19fbc8966fea0', 'request_id': 'req-64dd7f8c-2312-4d0f-8f25-051f807656c8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.114838 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225843-f029-44b9-a1f0-49b8d0fc3a86 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.119884 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] The token cache is being invalidate because project a288db55f4b34f7781f19fbc8966fea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:52.120180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.123918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64dd7f8c-2312-4d0f-8f25-051f807656c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.140710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 868/1737] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/projects/a288db55f4b34f7781f19fbc8966fea0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:52.140710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f27ff-a54d-4c1b-809d-fb461dd4a7b8 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.144857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f27ff-a54d-4c1b-809d-fb461dd4a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.145142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f27ff-a54d-4c1b-809d-fb461dd4a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.230808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8f8f27ff-a54d-4c1b-809d-fb461dd4a7b8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:52.232749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8f8f27ff-a54d-4c1b-809d-fb461dd4a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.298703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.299729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.303760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.304355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.316689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.424003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 869/1738] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:52.426414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f19c-0167-403f-938a-2eecfa22c440 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.427167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f19c-0167-403f-938a-2eecfa22c440 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.427752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185f19c-0167-403f-938a-2eecfa22c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.475483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6185f19c-0167-403f-938a-2eecfa22c440 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:52.479674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6185f19c-0167-403f-938a-2eecfa22c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.507472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 870/1739] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:52.509207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.527008 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.527400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.530864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.531414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.580534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 870/1740] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:52.612365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.615346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.640916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:52.645865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.678221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 871/1741] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:52.680209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.694809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536e370-6956-4cd1-90d7-7edd777c783d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.708864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.709923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.710516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.711133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.712008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:52.712593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.719640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.761450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 872/1742] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:52.762956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.777631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676d243-59b9-4b6d-b701-4363b97bf5cd admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.785825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.786720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.787109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.787496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.788247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.801831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.825413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bc2c0-c7ec-469f-8b4f-b055059ed525 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.842886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.848143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.850884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.851205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.855231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 873/1743] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:52.856834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.869804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.898599 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.908717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.970782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 871/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:52.971713 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.026797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acf745-e5d3-47ef-bb1a-d48f41fd04a4 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.041276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e723-ab59-4395-9c6b-0c0c37235937 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.048267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.050690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.050865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.051257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.051539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.052250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.052680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.053031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.055212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] PATH_INFO: `/v3/users/6c73abf8ae2e425ab4dda14fba94682d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.057142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c73abf8ae2e425ab4dda14fba94682d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.060067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.062728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.112945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:53.169411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c73abf8ae2e425ab4dda14fba94682d'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.173885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 872/1745] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:53.176622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.197110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c73abf8ae2e425ab4dda14fba94682d'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.220683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3377-4d97-46ff-9158-4ce9d211c391 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.267715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c73abf8ae2e425ab4dda14fba94682d'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.282771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c73abf8ae2e425ab4dda14fba94682d'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.282771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8043960c-0296-4cdd-8596-68b4773d8f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c73abf8ae2e425ab4dda14fba94682d'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.282975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.282975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.282975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.282975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.283306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.287813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.331035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 873/1746] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:53.332052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.337311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 874/1747] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:52 2022] DELETE /identity/v3/users/6c73abf8ae2e425ab4dda14fba94682d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:53.338520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.341940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.342244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.342527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.366442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c943be-0f46-4038-822d-b483e2a21dfa admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.395420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:53.419437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.420133 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.509268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.509268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.509268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.509268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.510641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.514040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.542388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 874/1748] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:53.544167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.569374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931605-9d8a-438c-9f39-0dcfc063a8b6 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.584385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.585171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.585468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.586431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] PATH_INFO: `/v3/projects/057a60d58d0344a0bb2dcc6cb51d476d/users/8234c9e0c21b46a0845d33ba196faec6/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.620727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=057a60d58d0344a0bb2dcc6cb51d476d, user_id=8234c9e0c21b46a0845d33ba196faec6, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.624033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03220a-0c12-4fa4-8aab-d09b55cbfb3b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.659368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 875/1749] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:53 2022] PUT /identity/v3/projects/057a60d58d0344a0bb2dcc6cb51d476d/users/8234c9e0c21b46a0845d33ba196faec6/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:53.660555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.662985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.663382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.671293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 875/1750] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:53.750390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.752696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.759480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] MFA Rules not processed for user `8234c9e0c21b46a0845d33ba196faec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.770918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.949399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7fb7-beef-4049-9f44-9788d810933a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.018752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 876/1751] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:54.021575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.127880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.128565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.128849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.129118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.146193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.215634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2537ae-ebb0-4e8e-bd07-f1927fcc71d6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.229000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.230935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.231994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.233163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.235414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.241409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.338848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 877/1752] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/projects => generated 381 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:54.343467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.360367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.415825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.417294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.456343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 876/1753] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:54.457643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.458575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:54.494608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cfe7-2a87-40ea-af31-1bdceb35dfe3 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.599140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c52b5-638e-4cd3-8d42-f6263e827c1a admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.607039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.607849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.608135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.609748 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.610478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.616728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.646437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.647451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.663236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.663613 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] PATH_INFO: `/v3/projects/6ee398f5fd59454784cb262d5968d163` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.670738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee398f5fd59454784cb262d5968d163)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.673261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.699465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 878/1754] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/users => generated 297 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:54.700981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.752432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccdc2b-1711-4b5d-aefc-4dfc5d9542bb admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.765481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.766597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.767264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.768101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.769418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.778183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.797136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee398f5fd59454784cb262d5968d163', 'request_id': 'req-4bc31704-3979-40ca-bc20-cce941393bdc'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:54.800778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 879/1755] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:54.805392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.806193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee398f5fd59454784cb262d5968d163', 'request_id': 'req-4bc31704-3979-40ca-bc20-cce941393bdc'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:54.814786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee398f5fd59454784cb262d5968d163', 'request_id': 'req-4bc31704-3979-40ca-bc20-cce941393bdc'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:54.828449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebd802-6cdf-46d7-917b-d90af5b0d05d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.849686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] The token cache is being invalidate because project 6ee398f5fd59454784cb262d5968d163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:54.850061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:54.851376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4bc31704-3979-40ca-bc20-cce941393bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:54.857019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 877/1756] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:54 2022] DELETE /identity/v3/projects/6ee398f5fd59454784cb262d5968d163 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:54.875063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4958c-ab29-4b3a-b346-cb42da31b023 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.875459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4958c-ab29-4b3a-b346-cb42da31b023 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.875744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4958c-ab29-4b3a-b346-cb42da31b023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.946861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-51c4958c-ab29-4b3a-b346-cb42da31b023 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:54.948116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-51c4958c-ab29-4b3a-b346-cb42da31b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:54.992963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.996622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.998085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.998463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] PATH_INFO: `/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7/users/8f8e30ab46f6414480b1c2fd9520e65a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.045744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd81dd1f56d64d6ea71dbcc25f83bbd7, user_id=8f8e30ab46f6414480b1c2fd9520e65a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.055873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.065247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:55.100228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 880/1757] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:54 2022] PUT /identity/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7/users/8f8e30ab46f6414480b1c2fd9520e65a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:55.104489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.109403 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.116857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 878/1758] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:55.128607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.129071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.129634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.216083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:55.219771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.277336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269feb-67c6-42eb-a377-eee2668b5a2e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.290782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.291441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.291734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.293441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.296012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.301724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.313380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:55.334577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 881/1759] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:55.336682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.338925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 879/1760] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:55.348398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.362272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa007b-db15-4e9a-950c-c3a8c561876e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.366091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b88a1-9efa-4fd8-969a-1076f525161c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.372616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.373412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.373894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.374217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.374990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:55.375401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.377344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.378119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.379502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.380941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.381682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] PATH_INFO: `/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7/users/8f8e30ab46f6414480b1c2fd9520e65a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.389104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd81dd1f56d64d6ea71dbcc25f83bbd7, user_id=8f8e30ab46f6414480b1c2fd9520e65a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.395253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf9d1-84b1-458c-b84f-c9d766ad529a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.427798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 880/1761] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:55.429757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 882/1762] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:55 2022] PUT /identity/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7/users/8f8e30ab46f6414480b1c2fd9520e65a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:55.432349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.442827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.443747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.444045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.467644 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8cc17-d0c7-4868-80c4-00e483e81de1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.517339 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] MFA Rules not processed for user `8f8e30ab46f6414480b1c2fd9520e65a`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:55.518657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.650453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.651424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.652000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.654394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.655977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.660791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.721304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 883/1763] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:55.728515 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 881/1764] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:55 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:55.732053 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.733218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.733536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.885889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:55.914925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c0ac4-09e0-475e-8427-7a1ad7bf4b7c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.922143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b08e5-1401-4a35-9fa0-36af5b6725c6 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.941701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.943072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.943277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.945952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.946941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.949938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.005119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 882/1765] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:55 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:56.006215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:56.038143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f9a3-5fb4-4f4c-99cb-816cd642abdb admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:56.058113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.059019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.059714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.059981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.060972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:56.065010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.075391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.076025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.076316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.076593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.105007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 883/1766] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:56.107150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:56.114827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.145448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8f7ec-74b1-45fb-8034-571e346a5327 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:56.162575 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.163491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.164823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.165709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] PATH_INFO: `/v3/projects/4560b5d331e14baeaebc5b9f241b1b05` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.170549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4560b5d331e14baeaebc5b9f241b1b05)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:56.177200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.211245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:56.282171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:56.283890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763edf09-8f8d-4df1-acb9-eb7ec41392a2 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.340991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 884/1767] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:56.344326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.344611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.344885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.347457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4560b5d331e14baeaebc5b9f241b1b05', 'request_id': 'req-a6a75a49-d46d-4692-8c58-82a236ec8efd'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.374486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4560b5d331e14baeaebc5b9f241b1b05', 'request_id': 'req-a6a75a49-d46d-4692-8c58-82a236ec8efd'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.414191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4560b5d331e14baeaebc5b9f241b1b05', 'request_id': 'req-a6a75a49-d46d-4692-8c58-82a236ec8efd'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.427906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:56.431750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.460728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] The token cache is being invalidate because project 4560b5d331e14baeaebc5b9f241b1b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:56.460728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.463211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.473402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 884/1768] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:56 2022] DELETE /identity/v3/projects/4560b5d331e14baeaebc5b9f241b1b05 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:56.474594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:56.486163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.586624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 885/1769] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 1 15:43:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:56.587512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:56.590072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.633554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75a49-d46d-4692-8c58-82a236ec8efd admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:56.655119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.655760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.656049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.657948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.658657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:56.660305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.705407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 885/1770] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:56.706388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:56.719697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.805578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e730-faff-4923-ba86-781e186383f5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:56.815539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.816445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.816903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.817316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] PATH_INFO: `/v3/users/85f414581d1043eaa28ff07f701d6baa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.825786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f414581d1043eaa28ff07f701d6baa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:56.828035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:56.865357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:56.930143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f414581d1043eaa28ff07f701d6baa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.935572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead764-4695-4548-a1c5-46cd1cbfbb27 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:56.940987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f414581d1043eaa28ff07f701d6baa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.941796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f414581d1043eaa28ff07f701d6baa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:56.944859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:56.946544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:56.948561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:56.948675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:56.955868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:56.999739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f414581d1043eaa28ff07f701d6baa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.000936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f414581d1043eaa28ff07f701d6baa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.037145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 886/1771] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:56 2022] DELETE /identity/v3/users/85f414581d1043eaa28ff07f701d6baa => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:57.037145 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.038902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.062194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:57.083221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:57.083221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:57.096566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 886/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:57.097730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.135216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3381a0-22c4-4210-9962-549d2d6ce8bc service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:57.282030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ca64c-811c-421e-b38e-1562e02f694b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:57.319114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:57.321700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.322912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.323196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.329106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.338909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:57.345314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.345647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.345947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] PATH_INFO: `/v3/projects/2a962c1dc36e425482b9e9a62a59f6a8/users/23520bcb6894494eaa53eb7564ef1fb7/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.400212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:57.407996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:57.428027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 887/1773] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:57.428497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a962c1dc36e425482b9e9a62a59f6a8, user_id=23520bcb6894494eaa53eb7564ef1fb7, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:57.431531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.438227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.439493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e16d6-e131-4f34-beb1-c9b6f81d1fc0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:57.465243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a5eca-50d8-4b14-90d0-25e36395b535 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:57.471050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 887/1774] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:57 2022] PUT /identity/v3/projects/2a962c1dc36e425482b9e9a62a59f6a8/users/23520bcb6894494eaa53eb7564ef1fb7/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:57.482370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.482370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.482640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.583087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] MFA Rules not processed for user `23520bcb6894494eaa53eb7564ef1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:57.584353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.678716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:57.679365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.679654 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.679933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.716474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:57.720019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad05d4-66f9-4668-a00a-87524de09d8b service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:57.744354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 888/1775] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:57.745682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.745987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.746273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.797731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] MFA Rules not processed for user `15920d222233448d866e9cfc8e692df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:57.800680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.812900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 888/1776] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:57.815010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.818878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.850712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:57.981020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 889/1777] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:57.981020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.995004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.045338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26c6a-3a36-480a-b632-f3fa169a2509 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.076949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94e6d-3459-4a87-b5a6-7f9e8afe5cff None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.083077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.083750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.084108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.084323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] PATH_INFO: `/v3/projects/8a9553d2af814479ae1e2e8890e53d6e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.093537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9553d2af814479ae1e2e8890e53d6e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.097222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.097867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.098184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.114493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.115676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.116914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.142412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.223177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 890/1778] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:57 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:58.236925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.291185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9553d2af814479ae1e2e8890e53d6e', 'request_id': 'req-08cde838-d56c-4169-ab0f-a1f849964734'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.312026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9553d2af814479ae1e2e8890e53d6e', 'request_id': 'req-08cde838-d56c-4169-ab0f-a1f849964734'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.326187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9553d2af814479ae1e2e8890e53d6e', 'request_id': 'req-08cde838-d56c-4169-ab0f-a1f849964734'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.342613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:58.354748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] The token cache is being invalidate because project 8a9553d2af814479ae1e2e8890e53d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:58.358742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.363472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.368437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 889/1779] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:57 2022] DELETE /identity/v3/projects/8a9553d2af814479ae1e2e8890e53d6e => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:58.373143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.374421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.378870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7f04-fe21-4ca8-bce9-aaf60d396b15 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.512034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.512852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.513139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.513458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.515377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.518074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.568538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 891/1780] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:58 2022] POST /identity/v3/users => generated 296 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:58.570213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.574090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.588220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde838-d56c-4169-ab0f-a1f849964734 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.601684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899ece-828e-4a4d-a6c1-3ff3b9860655 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.608453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.610068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.610360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.610642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] PATH_INFO: `/v3/users/9ae0745696d84a519bb505eab0c3b5c6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.615775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae0745696d84a519bb505eab0c3b5c6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.616007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.616633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.616844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.617186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.617843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.620031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.621643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.654462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 892/1781] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:58.656165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.691938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083680d-f320-4dea-b953-2f3c4806aad5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.729826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.730646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.731615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.732828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] PATH_INFO: `/v3/projects/69c2b74269704576881b1b066c874ff9/users/73e82a3510024ff699e0a0d78c7b9268/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.760580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:58.769661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae0745696d84a519bb505eab0c3b5c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.781718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c2b74269704576881b1b066c874ff9, user_id=73e82a3510024ff699e0a0d78c7b9268, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.786676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae0745696d84a519bb505eab0c3b5c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.790175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.820114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae0745696d84a519bb505eab0c3b5c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.822195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae0745696d84a519bb505eab0c3b5c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.823645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae0745696d84a519bb505eab0c3b5c6'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.824758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 893/1782] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:58 2022] PUT /identity/v3/projects/69c2b74269704576881b1b066c874ff9/users/73e82a3510024ff699e0a0d78c7b9268/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:58.829551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.831924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.872816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 890/1783] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:58 2022] DELETE /identity/v3/users/9ae0745696d84a519bb505eab0c3b5c6 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:58.979573 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00138130-67ac-4218-95d6-2e45bfc83727 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.039222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:59.063735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.064380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.064668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.064948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.066025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.067380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f9ce-b3a6-47e5-a8e9-111203905848 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.101979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 894/1784] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:59.103591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:59.127865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f3155-59cb-40c8-8672-c3b033d4608a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.150882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.152207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.152494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.156432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] PATH_INFO: `/v3/projects/69c2b74269704576881b1b066c874ff9/users/73e82a3510024ff699e0a0d78c7b9268/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.170314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c2b74269704576881b1b066c874ff9, user_id=73e82a3510024ff699e0a0d78c7b9268, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.183554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.239415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 891/1785] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:59 2022] PUT /identity/v3/projects/69c2b74269704576881b1b066c874ff9/users/73e82a3510024ff699e0a0d78c7b9268/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:59.257902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.258737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.259083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.298819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] MFA Rules not processed for user `73e82a3510024ff699e0a0d78c7b9268`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:59.300567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.447194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 895/1786] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:59.454296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:59.457234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.592424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc55dd-5848-4c0d-b672-a69ef24be72b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.604308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.604949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.605289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.605574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.629702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.631421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.655287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 892/1787] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:59.847351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:59.850162 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.868924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5ad41-03d4-4b34-8c54-012774a6a53c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.877268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.879195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.879397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.879712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.882165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.991487 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.999750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.012282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 896/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:00.642088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.645183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:00.664318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.666058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:00.837521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1dee1-aa27-4a83-9a0e-1de7a1de4a74 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.843189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42dbd2-609b-45fe-a9b2-161d3ec53bb3 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.849499 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.850209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.850496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.850776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] PATH_INFO: `/v3/projects/276654b415bf4c55a1bedd9e5c862805` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.851968 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276654b415bf4c55a1bedd9e5c862805)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.854245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.855447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.856653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.856931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.857202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] PATH_INFO: `/v3/projects/7105faf0cf0d41948d7057e75a5bdacf` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.863925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7105faf0cf0d41948d7057e75a5bdacf)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.866010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.870127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:00.972045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276654b415bf4c55a1bedd9e5c862805', 'request_id': 'req-6c07a658-bd17-4ee7-b50e-d08201d80e74'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:00.991060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276654b415bf4c55a1bedd9e5c862805', 'request_id': 'req-6c07a658-bd17-4ee7-b50e-d08201d80e74'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.002018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276654b415bf4c55a1bedd9e5c862805', 'request_id': 'req-6c07a658-bd17-4ee7-b50e-d08201d80e74'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.021032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] The token cache is being invalidate because project 276654b415bf4c55a1bedd9e5c862805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:01.021349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.030530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.032331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 897/1789] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:00 2022] DELETE /identity/v3/projects/276654b415bf4c55a1bedd9e5c862805 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:01.033368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:01.034946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.038648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7105faf0cf0d41948d7057e75a5bdacf', 'request_id': 'req-64034c66-1847-48f9-b932-af417e2545d8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.048174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:01.070806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7105faf0cf0d41948d7057e75a5bdacf', 'request_id': 'req-64034c66-1847-48f9-b932-af417e2545d8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.091152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7105faf0cf0d41948d7057e75a5bdacf', 'request_id': 'req-64034c66-1847-48f9-b932-af417e2545d8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.129001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] The token cache is being invalidate because project 7105faf0cf0d41948d7057e75a5bdacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:01.129655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.130588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64034c66-1847-48f9-b932-af417e2545d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.135397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 893/1790] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:00 2022] DELETE /identity/v3/projects/7105faf0cf0d41948d7057e75a5bdacf => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:01.146375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575812-7ab0-4cd9-8f7c-93e992b39c45 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.146667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575812-7ab0-4cd9-8f7c-93e992b39c45 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.146945 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575812-7ab0-4cd9-8f7c-93e992b39c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.239878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a658-bd17-4ee7-b50e-d08201d80e74 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:01.242237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-03575812-7ab0-4cd9-8f7c-93e992b39c45 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:01.243477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-03575812-7ab0-4cd9-8f7c-93e992b39c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.458791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 894/1791] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:01.460069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f5d4-a30d-4194-b1c3-3e6dc2506310 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.460354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f5d4-a30d-4194-b1c3-3e6dc2506310 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.460632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f5d4-a30d-4194-b1c3-3e6dc2506310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.471813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:01.472847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.473385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.473773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] PATH_INFO: `/v3/users/8234c9e0c21b46a0845d33ba196faec6` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.476559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8234c9e0c21b46a0845d33ba196faec6)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:01.481922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:01.507524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-eb59f5d4-a30d-4194-b1c3-3e6dc2506310 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:01.508448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-eb59f5d4-a30d-4194-b1c3-3e6dc2506310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 895/1792] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714e87b-56d5-4274-8a6d-57936cef2cde None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714e87b-56d5-4274-8a6d-57936cef2cde None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714e87b-56d5-4274-8a6d-57936cef2cde None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 896/1793] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11638f-8dc7-4d6b-b6dc-d92f0a14ad6b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.548529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11638f-8dc7-4d6b-b6dc-d92f0a14ad6b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.549274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11638f-8dc7-4d6b-b6dc-d92f0a14ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.606710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5e11638f-8dc7-4d6b-b6dc-d92f0a14ad6b None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:01.614758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5e11638f-8dc7-4d6b-b6dc-d92f0a14ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.631809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:01.633608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 897/1794] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:01.637431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769181-6a77-424d-bd90-e870e2424f16 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.637431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769181-6a77-424d-bd90-e870e2424f16 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.637431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769181-6a77-424d-bd90-e870e2424f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.643889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8234c9e0c21b46a0845d33ba196faec6'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.673725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8234c9e0c21b46a0845d33ba196faec6'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.675164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8234c9e0c21b46a0845d33ba196faec6'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.697072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b3769181-6a77-424d-bd90-e870e2424f16 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:01.704056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b3769181-6a77-424d-bd90-e870e2424f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.719133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8234c9e0c21b46a0845d33ba196faec6'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.721682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8234c9e0c21b46a0845d33ba196faec6'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.739794 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 898/1795] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:01.741231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0a8a-f112-4ff1-bbd0-32b12e4194b0 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.741655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0a8a-f112-4ff1-bbd0-32b12e4194b0 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.742056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0a8a-f112-4ff1-bbd0-32b12e4194b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.758067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 898/1796] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:01 2022] DELETE /identity/v3/users/8234c9e0c21b46a0845d33ba196faec6 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:01.758067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:01.758067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.811320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2b8c0a8a-f112-4ff1-bbd0-32b12e4194b0 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:01.812924 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2b8c0a8a-f112-4ff1-bbd0-32b12e4194b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.937336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00669f-2b9e-49ee-a86a-b104fd45aad2 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:01.964399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:01.965136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.965421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.965715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.967311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:01.967593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:01.969293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5b0ae-c7f9-4548-902f-97e305416eae admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.029303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 899/1797] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:02.031618 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.031907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.032184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.033582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 900/1798] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:44:02.060045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.067587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.120757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caad39-fa05-431c-b5af-1a97e952818e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.121078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 899/1799] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.123274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a416c0-c920-4703-bb1a-ab9394a07ff4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.123715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a416c0-c920-4703-bb1a-ab9394a07ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.124174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a416c0-c920-4703-bb1a-ab9394a07ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.139806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.140673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.141114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.151863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.154246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:02.155233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.164279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.185022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-96a416c0-c920-4703-bb1a-ab9394a07ff4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:02.192616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-96a416c0-c920-4703-bb1a-ab9394a07ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.269017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 901/1800] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:02.270283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.298799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 900/1801] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.300360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.300659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.301227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.331822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5098df-2001-4785-81d3-2985d7265ab1 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.358811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.359566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.366407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.367919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.368742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.374481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.381638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:02.386537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.430171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 901/1802] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.433692 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.466221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1f57-5172-48e2-8436-843dbf912a03 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.476933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.479109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.479395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.479694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.483033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.489298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.501492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 902/1803] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:02.505882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.519848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.567151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 902/1804] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:02.603530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.692857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:02.741807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada88f9-74d4-4c2e-af16-22931ba1c678 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.825671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba90d8-a0cb-4e47-9062-cb182c26c760 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.832012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.832907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.834054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.834627 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.835747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.837918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.859341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:02.881513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 903/1805] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:02.882538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.908318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1227c3-bb93-4aa9-886e-31bacfd6817d admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.917466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.919285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.919612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.920171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.925161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.925890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.926135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.926448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.927181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.932967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.951683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.953148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.975410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 903/1806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:02.978662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.982624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.990253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 904/1807] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:02.991043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.014171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b8ef-c1ba-4c56-96e6-0551798ca8ca admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.031213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.031834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.032347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.032766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.033580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.035369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.064748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 905/1808] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:03.066254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.079853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c5be-0668-482e-90b9-0713ac3d0dec admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.085057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.085938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.086388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.086807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.087612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.090809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.133912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 906/1809] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:03.135566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.151619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebceb1-cc39-441b-8ec6-205e904ecb2c service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.160016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0371-a1ba-48e6-89be-437039fe57d1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.160234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.161304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.161304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.161729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.173359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.174878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.175968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.176632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.176915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.177271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.180032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.186207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.193832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 904/1810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:03.195069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.210890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 907/1811] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:03.212446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.228588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9bb49-9155-4ea5-a0c1-86933addb3aa service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.237804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d5f3-3253-49ef-9559-9c0697f68681 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.246834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.247906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.248191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.248478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.249132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.250822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.251455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.251737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.252022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] PATH_INFO: `/v3/projects/ccd208a60c6d46439a578fdc1d8a1291/users/cfc64cdfbc4f42809d9cae66dfcd6298/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.253695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.278882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd208a60c6d46439a578fdc1d8a1291, user_id=cfc64cdfbc4f42809d9cae66dfcd6298, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.286603 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5cdb8-05de-4bd4-a6a8-bca9858db8ac admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.300463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 905/1812] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:03.305501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.336611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 908/1813] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:03 2022] PUT /identity/v3/projects/ccd208a60c6d46439a578fdc1d8a1291/users/cfc64cdfbc4f42809d9cae66dfcd6298/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:03.338570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.339045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.339583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.358553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24b10-4b3b-4df3-a6a6-9072c2e7e554 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.426045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] MFA Rules not processed for user `cfc64cdfbc4f42809d9cae66dfcd6298`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:03.427311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:03.633872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.634908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.635362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.635782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] PATH_INFO: `/v3/projects/6e71dd6e389946d4809e1161e59c6732/users/adaac6e51ed6430db79a3efcf6096f01/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.651956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 909/1814] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:03.653498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.670277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:03.691972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e71dd6e389946d4809e1161e59c6732, user_id=adaac6e51ed6430db79a3efcf6096f01, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.697833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:03.717840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:03.724404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 906/1815] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:03 2022] PUT /identity/v3/projects/6e71dd6e389946d4809e1161e59c6732/users/adaac6e51ed6430db79a3efcf6096f01/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:03.725364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:03.812473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f754-07f5-49a3-9868-9a317c80783a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.826274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:03.911905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe65f5-471d-4155-b411-80cf141cba5e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:03.933219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:03.937998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:03.943059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:03.943372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:03.944447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:03.967013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4b46d-d771-40d2-ace3-4cb9b059f257 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.014870 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.015546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.015955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.016364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.031719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.033769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.039123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 907/1816] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:03 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:04.040890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.041227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.042207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.054116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 910/1817] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:04.069392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.095359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240ac72-b117-4ebf-b2cb-6616a0cc130c service nova] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.129847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] MFA Rules not processed for user `adaac6e51ed6430db79a3efcf6096f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:04.133530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.276900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.278676 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.278901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.279003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.279623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.281549 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.333362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 908/1818] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:04.335154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.337981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.348914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 911/1819] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:04 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:04.348914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.359844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6712b-675d-4b56-b92a-084d84660c98 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.362481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245caf2c-c307-4345-bb57-ca4688b351ab None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.366818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.367826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.368210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.368380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.369357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.371624 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.372602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.374724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.375287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.375783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] PATH_INFO: `/v3/projects/057a60d58d0344a0bb2dcc6cb51d476d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.377304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057a60d58d0344a0bb2dcc6cb51d476d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.380369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.418673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 912/1820] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:04 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:04.420623 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.453069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:04.493592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057a60d58d0344a0bb2dcc6cb51d476d', 'request_id': 'req-62ae0898-0c55-4295-9260-5d6c7bf6ab32'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.522960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057a60d58d0344a0bb2dcc6cb51d476d', 'request_id': 'req-62ae0898-0c55-4295-9260-5d6c7bf6ab32'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.572595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057a60d58d0344a0bb2dcc6cb51d476d', 'request_id': 'req-62ae0898-0c55-4295-9260-5d6c7bf6ab32'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.576880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cab5a-e82c-4bd2-8159-e1f5ad0044ca admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.612959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] The token cache is being invalidate because project 057a60d58d0344a0bb2dcc6cb51d476d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:04.614210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.615839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.621170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 909/1821] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:04 2022] DELETE /identity/v3/projects/057a60d58d0344a0bb2dcc6cb51d476d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:04.622991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.625870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.687526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:04.690594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.691237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.691527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.691795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.692458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.694360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.709212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 913/1822] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:04.709212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.711157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.739215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe575-8558-4a0b-a12b-10d52e05a781 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.744295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.744971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.745223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.745497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] PATH_INFO: `/v3/users/8f8e30ab46f6414480b1c2fd9520e65a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.746742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8e30ab46f6414480b1c2fd9520e65a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.749151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.761367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0898-0c55-4295-9260-5d6c7bf6ab32 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.772024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.772883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.773395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.773624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.774382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.776634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.801449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 910/1823] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:04 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:04.802607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.807560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.816757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8e30ab46f6414480b1c2fd9520e65a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.821747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb34a56-6354-4c71-a91d-c194192a670c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.827055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8e30ab46f6414480b1c2fd9520e65a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.830273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:04.831037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:04.831591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:04.831925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:04.832660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:04.834433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:04.844583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8e30ab46f6414480b1c2fd9520e65a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.845559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8e30ab46f6414480b1c2fd9520e65a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.846417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8e30ab46f6414480b1c2fd9520e65a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:04.849166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 911/1824] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:04.849718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.853703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.863502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 914/1825] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:04 2022] DELETE /identity/v3/users/8f8e30ab46f6414480b1c2fd9520e65a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:04.865224 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:04.871181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:04.875088 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6079ec1-9054-4005-92ab-40d517ff7184 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:04.925818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:04.991880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433f89d-ce4d-496c-92c9-d7fb7f572849 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.000279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.001457 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.001875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.003019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] PATH_INFO: `/v3/projects/eca20d0577cf48eea55c4a379280a628/users/ac796851a0df4c1c96552735379cffe3/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.026933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca20d0577cf48eea55c4a379280a628, user_id=ac796851a0df4c1c96552735379cffe3, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.030443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41640723-64b5-4e9b-b53d-7a213a71815d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.064595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 915/1826] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:04 2022] PUT /identity/v3/projects/eca20d0577cf48eea55c4a379280a628/users/ac796851a0df4c1c96552735379cffe3/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:05.066320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.066840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.067257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.096148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.097004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.098322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.098765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.099866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.101631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.106910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] MFA Rules not processed for user `ac796851a0df4c1c96552735379cffe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:05.108305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:05.116052 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 912/1827] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:05.121321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.139168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9fd8-724a-400e-a1bd-b63565b106d5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.289258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 916/1828] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:05.296495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.348305 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.352500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.352930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.353279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] PATH_INFO: `/v3/projects/ee799745c1964b81ae6ca43be7b5552e/users/922e4562360049f281fa807bd1ee4e82/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.400517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee799745c1964b81ae6ca43be7b5552e, user_id=922e4562360049f281fa807bd1ee4e82, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.404385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.427498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 913/1829] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:05 2022] PUT /identity/v3/projects/ee799745c1964b81ae6ca43be7b5552e/users/922e4562360049f281fa807bd1ee4e82/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:05.431373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.457234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffa55f-b2cb-4c88-a3ff-b819e4013d1b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.520330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:05.596786 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f2da-5223-44cc-ad26-28e5c836fa36 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.597762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:05.606657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.607552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.608039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.608655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.610665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.615812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.639387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 914/1830] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:05.648794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.649217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.649819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.650124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.650391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.655781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.658274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.676578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97651a6d-5033-4ea8-be33-6f7b4f0e9105 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.690606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.691423 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.691556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.691828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] PATH_INFO: `/v3/projects/ee799745c1964b81ae6ca43be7b5552e/users/922e4562360049f281fa807bd1ee4e82/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.694025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee799745c1964b81ae6ca43be7b5552e, user_id=922e4562360049f281fa807bd1ee4e82, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.697746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21cc0-15c5-4551-b844-fc0d3c679cea admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.725292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 917/1831] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:05 2022] POST /identity/v3/projects => generated 387 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:05.725550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 915/1832] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:05 2022] PUT /identity/v3/projects/ee799745c1964b81ae6ca43be7b5552e/users/922e4562360049f281fa807bd1ee4e82/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:05.729258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.739118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.739239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.739459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.781117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] MFA Rules not processed for user `922e4562360049f281fa807bd1ee4e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:05.782994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:05.835300 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc97c-f76f-4848-bcab-fae0845aaeab admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.841364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.842196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.842698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.843140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.843975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.846698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.880848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 918/1833] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:05 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:05.880848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.883032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:05.901390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd7a8-3f9d-4930-aeb7-e381bc0f6e3f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.911382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 916/1834] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:05.914964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.915859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.916787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.917159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.917337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] PATH_INFO: `/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.920470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd81dd1f56d64d6ea71dbcc25f83bbd7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.922959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.928269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701969e-7030-49bb-9c4c-67b1e17730c3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:05.935205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:05.936021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:05.936332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:05.936579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:05.937236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:05.939582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:05.955849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 917/1835] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:05.955849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:05.957426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:05.981579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd81dd1f56d64d6ea71dbcc25f83bbd7', 'request_id': 'req-5e76b483-9256-49f3-91ab-a75f603282d9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:05.987677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd81dd1f56d64d6ea71dbcc25f83bbd7', 'request_id': 'req-5e76b483-9256-49f3-91ab-a75f603282d9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:05.996879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd81dd1f56d64d6ea71dbcc25f83bbd7', 'request_id': 'req-5e76b483-9256-49f3-91ab-a75f603282d9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.014557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] The token cache is being invalidate because project cd81dd1f56d64d6ea71dbcc25f83bbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:06.014850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.015542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.018053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 919/1836] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:05 2022] DELETE /identity/v3/projects/cd81dd1f56d64d6ea71dbcc25f83bbd7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:06.018984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.020326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.032797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d19e-6729-42e5-99ff-295906b05fed admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.085112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:06.086541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:06.102263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.103649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.104185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.104511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.107363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.113663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76b483-9256-49f3-91ab-a75f603282d9 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.120620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.121326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.121664 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.121941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] PATH_INFO: `/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd/users/0d6a84a0f933488d892b87e6a2a7c151/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.140232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2731926e4a6d44bda573dd9d5fd0ffdd, user_id=0d6a84a0f933488d892b87e6a2a7c151, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.143436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b528-f570-4e89-ad80-4f41623ecc07 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.165284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 920/1837] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:06 2022] PUT /identity/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd/users/0d6a84a0f933488d892b87e6a2a7c151/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:06.165284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.165284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.165284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.188790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:06.190178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.195673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.197716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.216089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 918/1838] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:06.217064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.232130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af01be-9705-4cbd-bcc2-70c946ac2d3d service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.282838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 921/1839] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:06.283988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.285311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.300154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703a59-f9a6-4a8c-9255-0d643b09adf7 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.304894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.305534 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.305835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.306139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] PATH_INFO: `/v3/users/adaac6e51ed6430db79a3efcf6096f01` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.307293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaac6e51ed6430db79a3efcf6096f01)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.309303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.315512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.316320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.316608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.317050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.317727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.319836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c1a85-f6d1-44dd-948e-d92cc885f4e1 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.334500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 919/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:06.335846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.336197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.336538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.357902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:06.359241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.364106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaac6e51ed6430db79a3efcf6096f01'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.367585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 920/1841] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:06.368405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.372412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaac6e51ed6430db79a3efcf6096f01'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.378124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe12ed-cc30-4de8-a644-1302015b2aae None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.383003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.383682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.383985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.384259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] PATH_INFO: `/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd/users/0d6a84a0f933488d892b87e6a2a7c151/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.385737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaac6e51ed6430db79a3efcf6096f01'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.386166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2731926e4a6d44bda573dd9d5fd0ffdd, user_id=0d6a84a0f933488d892b87e6a2a7c151, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.386530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaac6e51ed6430db79a3efcf6096f01'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.387716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-8504d863-b836-435e-9f11-ad122ac98e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaac6e51ed6430db79a3efcf6096f01'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:06.389321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.399796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 921/1842] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:06 2022] PUT /identity/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd/users/0d6a84a0f933488d892b87e6a2a7c151/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:06.400585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.400920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 922/1843] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:06 2022] DELETE /identity/v3/users/adaac6e51ed6430db79a3efcf6096f01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:06.405743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8af4-f2bf-478b-aa02-64c0cc3986b1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.406218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8af4-f2bf-478b-aa02-64c0cc3986b1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.406368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8af4-f2bf-478b-aa02-64c0cc3986b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.408798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.427149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b44a8af4-f2bf-478b-aa02-64c0cc3986b1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:06.428380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b44a8af4-f2bf-478b-aa02-64c0cc3986b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.468787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:06.476610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dccbc-d0d8-4d26-abe7-47e784a1b7c7 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.489903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:06.492546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 923/1844] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:06.493904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.494272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.494611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.526836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] MFA Rules not processed for user `0d6a84a0f933488d892b87e6a2a7c151`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:06.528769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.541150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.541847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.542217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.542589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.543521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:06.543886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.545500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.559019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 922/1845] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:06.560075 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.561757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.643640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e99a1-ba6c-44c5-9456-2432b97b74a9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.654529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 924/1846] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:06.654651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.654651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.654651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.654881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.654979 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.667148 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73aae-92b4-49db-8cc2-4846bc6dd973 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.673619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.675415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.691139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.691786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.692053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.694791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.695479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.697406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.701574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 923/1847] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:06.702953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.705019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:06.744078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 925/1848] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:06.749106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.787954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1df92-70e8-436b-b370-898b8596dd6f service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.879080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa66b90-47c8-4eba-b856-db6fc7d36c06 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.880021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.880770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.881171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.881549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.895183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.896843 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.898152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.898650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.900503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.904872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:06.926193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:06.960404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 926/1849] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:06 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:06.961431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:06.977548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1b11-fd68-483d-934a-bed14473e412 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:06.985248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:06.986195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:06.986314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:06.986706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:06.987587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:06.990951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.010209 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 927/1850] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:07.015042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.019029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.021424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.030606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41861-a68c-4098-9c20-717317439788 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.036612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 924/1851] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:07.039743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.040483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.041387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.041730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.044019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.046360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7c8b9-dc12-468f-9b19-111febd13f89 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.060608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 928/1852] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:07.066357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.082227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271b2ae-ba9a-40cc-a460-3ce89177d3bb service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.092911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.094708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.095006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.095291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] PATH_INFO: `/v3/projects/64ae7cdc79654f6fa41e4dbfaa218dd0/users/887af1f846094964af09bd64ff95e52a/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.121994 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ae7cdc79654f6fa41e4dbfaa218dd0, user_id=887af1f846094964af09bd64ff95e52a, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.126576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.159986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.160461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.160592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.161888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 925/1853] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:07 2022] PUT /identity/v3/projects/64ae7cdc79654f6fa41e4dbfaa218dd0/users/887af1f846094964af09bd64ff95e52a/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:07.222113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:07.226098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] MFA Rules not processed for user `887af1f846094964af09bd64ff95e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:07.227519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.318550 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 929/1854] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:07.319287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.331100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.334248 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.474553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d0e2-9d4f-4abb-9e83-69c350927875 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.484519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.485894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.486330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.486562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.486768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c13c-5c81-43aa-9d9a-cec5b07e6fa6 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.487547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.490373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.504501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.505165 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.505450 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.505731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] PATH_INFO: `/v3/projects/6e71dd6e389946d4809e1161e59c6732` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.506939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e71dd6e389946d4809e1161e59c6732)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.508866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.570159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 926/1855] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:07 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:07.574027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.582525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e71dd6e389946d4809e1161e59c6732', 'request_id': 'req-e0f98cb8-78e1-4754-99df-037606f4f744'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:07.593036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e71dd6e389946d4809e1161e59c6732', 'request_id': 'req-e0f98cb8-78e1-4754-99df-037606f4f744'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:07.601684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e71dd6e389946d4809e1161e59c6732', 'request_id': 'req-e0f98cb8-78e1-4754-99df-037606f4f744'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:07.641331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] The token cache is being invalidate because project 6e71dd6e389946d4809e1161e59c6732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:07.641749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:07.642892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:07.645360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 930/1856] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:07 2022] DELETE /identity/v3/projects/6e71dd6e389946d4809e1161e59c6732 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:07.649935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.652068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.758356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dc09d-09c4-45e8-b821-31d16ac9c8bd admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.771364 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.772354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.774712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.775518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.778972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.788096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.793340 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:07.873807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 927/1857] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:07 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:07.878418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.881637 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.892102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f98cb8-78e1-4754-99df-037606f4f744 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.899275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.900492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.906446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.906739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] PATH_INFO: `/v3/users/922e4562360049f281fa807bd1ee4e82` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.908714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] RBAC: Authorizing `identity:delete_user(user_id=922e4562360049f281fa807bd1ee4e82)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.910735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.912302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aaad0-4113-41b4-8564-aebba456e00d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.920695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.921818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.922514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.923247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.924254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.926157 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.938255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:07.971479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 928/1858] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:07.973310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.988028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fef55-c48d-4d7d-b273-c322c5f7c66c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.997772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.998504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.998789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.999066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] PATH_INFO: `/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e/users/03a5959fd3f048a78615c9fa5e3010d5/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.006273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922e4562360049f281fa807bd1ee4e82'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.017186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922e4562360049f281fa807bd1ee4e82'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.026702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e657ed994d8d4a979d2e5bb7a46b0d8e, user_id=03a5959fd3f048a78615c9fa5e3010d5, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.029793 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.047379 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922e4562360049f281fa807bd1ee4e82'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.048317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 929/1859] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:07 2022] PUT /identity/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e/users/03a5959fd3f048a78615c9fa5e3010d5/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:08.051109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922e4562360049f281fa807bd1ee4e82'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.052161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:08.052812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922e4562360049f281fa807bd1ee4e82'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.056506 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.086124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 931/1860] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:07 2022] DELETE /identity/v3/users/922e4562360049f281fa807bd1ee4e82 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:08.151802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09bd23-3afb-44aa-966e-e80bcfa2b414 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:08.159964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:08.161589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.261010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6275c8b-fd39-46cf-8151-7813c0db734f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:08.264243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:08.264961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.265135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:08.265290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.265569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.265696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.266039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.266319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.266691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.268403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.269592 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.289287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 930/1861] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:08.292581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:08.312598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d48ff-2c27-491f-a530-02ae69623c2f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:08.317598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:08.318789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.319128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.319840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] PATH_INFO: `/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e/users/03a5959fd3f048a78615c9fa5e3010d5/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.323189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e657ed994d8d4a979d2e5bb7a46b0d8e, user_id=03a5959fd3f048a78615c9fa5e3010d5, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.328887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc2b6e-324c-4dc6-ad9d-3cd623c5ecf4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.345031 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 931/1862] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:08 2022] PUT /identity/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e/users/03a5959fd3f048a78615c9fa5e3010d5/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:08.356983 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.357559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.357840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.368267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.370126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.385496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 932/1863] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:08.397187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] MFA Rules not processed for user `03a5959fd3f048a78615c9fa5e3010d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:08.398459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.500219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:08.501647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.524584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5e52-4c14-44ff-89c3-7682bbf21a89 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:08.529167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:08.547214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:08.573688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 932/1864] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:08.589205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:08.592848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:08.693785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499a14-7d7f-4348-9cb2-b29d217012d6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:08.701144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:08.702547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.702831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.703104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.728780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.731628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:08.732373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac13d1-dee9-49f1-bc52-81e2c2839d3e service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.733364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.733643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.733953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] PATH_INFO: `/v3/projects/ee799745c1964b81ae6ca43be7b5552e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.738136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee799745c1964b81ae6ca43be7b5552e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:08.742334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:08.757239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 933/1865] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:08.836150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee799745c1964b81ae6ca43be7b5552e', 'request_id': 'req-e0ac5713-34b1-4b9c-a446-5f0f41752007'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.852919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee799745c1964b81ae6ca43be7b5552e', 'request_id': 'req-e0ac5713-34b1-4b9c-a446-5f0f41752007'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.882411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee799745c1964b81ae6ca43be7b5552e', 'request_id': 'req-e0ac5713-34b1-4b9c-a446-5f0f41752007'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.906024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] The token cache is being invalidate because project ee799745c1964b81ae6ca43be7b5552e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:08.906382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.907584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e0ac5713-34b1-4b9c-a446-5f0f41752007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:08.910326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 933/1866] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:08 2022] DELETE /identity/v3/projects/ee799745c1964b81ae6ca43be7b5552e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:08.915649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:08.916335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:08.916885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:08.953121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:08.954627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.166331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 934/1867] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:09.174132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.175359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.175808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.220755 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:09.225152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.245078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:09.247810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.262844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 934/1868] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:09.266674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:09.270662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42106e-1636-4c9b-98f0-c99a68506ad2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:09.285606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f20f-c80d-4aa6-b3f9-b084b68ea52d None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:09.286788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:09.287846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.288228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.288602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] PATH_INFO: `/v3/users/887af1f846094964af09bd64ff95e52a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.290905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=887af1f846094964af09bd64ff95e52a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:09.299795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:09.308540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:09.310294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.311842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.312322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.313937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:09.314532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:09.317647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:09.377233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 935/1869] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:09.380592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:09.384901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.458610 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bef4-e3f4-47bf-9511-49cacc690b78 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:09.468150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887af1f846094964af09bd64ff95e52a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.480382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:09.484017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.484934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.485992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] PATH_INFO: `/v3/users/23520bcb6894494eaa53eb7564ef1fb7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.491142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23520bcb6894494eaa53eb7564ef1fb7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:09.491870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887af1f846094964af09bd64ff95e52a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.512776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887af1f846094964af09bd64ff95e52a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.512913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:09.540762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887af1f846094964af09bd64ff95e52a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.541675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887af1f846094964af09bd64ff95e52a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.578685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 935/1870] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:09 2022] DELETE /identity/v3/users/887af1f846094964af09bd64ff95e52a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:09.578685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:09.583104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.602536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:09.651858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23520bcb6894494eaa53eb7564ef1fb7'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.678635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23520bcb6894494eaa53eb7564ef1fb7'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.710568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23520bcb6894494eaa53eb7564ef1fb7'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.711533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23520bcb6894494eaa53eb7564ef1fb7'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.712184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-49560ded-790e-4281-bdb7-9c0b520b73e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23520bcb6894494eaa53eb7564ef1fb7'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:09.713707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:09.745270 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 936/1871] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:09 2022] DELETE /identity/v3/users/23520bcb6894494eaa53eb7564ef1fb7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:09.750122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1aa01-0191-483f-8eda-fcd5c08d7e83 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.750417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1aa01-0191-483f-8eda-fcd5c08d7e83 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.750700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1aa01-0191-483f-8eda-fcd5c08d7e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.751099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602213a-3834-4155-8dd5-8ab3c724f04c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:09.774733 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-61e1aa01-0191-483f-8eda-fcd5c08d7e83 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:09.775998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-61e1aa01-0191-483f-8eda-fcd5c08d7e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.869301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:09.873294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.873294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.873294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.873294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:09.876288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:09.905235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 937/1872] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:09.907085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.907373 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.907726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.932674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:09.935050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.942751 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 938/1873] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:09.943476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:09.944799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.052598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382f9c6-412d-47b8-898f-9c280b3d78ff None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.070469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.071134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.071432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.071744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.091209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 936/1874] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:09 2022] POST /identity/v3/projects => generated 377 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:10.092218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.095240 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.111567 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.116143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.138117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 939/1875] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:10.154393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.158951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.195035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe664bc-8d8b-4afe-97f6-c5d5ee29d425 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.219854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865254f-ac4d-4e60-859a-a48f21b0d475 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.230107 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.233185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.234235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.236105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.322208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.323684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.324190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.325187 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.326726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.330509 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.382745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:10.387562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 940/1876] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:10 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:10.392418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.416475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.417853 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21da59-cf4b-4dd1-b005-33fd89e59204 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.427492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.435908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.436544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.436830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.437108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.437776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.439399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.451765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 941/1877] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:10.456296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 937/1878] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:10.457440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.476470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:10.489251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832ce5f-9ea8-4dd1-9295-142e7ab36d58 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.501566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.502548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.502985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.504317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.505202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.509343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ad9f9-9ad2-409b-b70c-3e9d669e154e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.546006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 942/1879] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:10.552995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.565761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c821-2a9d-4cd1-8811-2c002bf9fcdf service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.574698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.575636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.576068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.576549 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] PATH_INFO: `/v3/projects/590222702b814f20b62aead3f98428e7/users/7695c0cee5ad4298ad615a3dfb19014c/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.619603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590222702b814f20b62aead3f98428e7, user_id=7695c0cee5ad4298ad615a3dfb19014c, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.624633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.647071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 938/1880] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:10 2022] PUT /identity/v3/projects/590222702b814f20b62aead3f98428e7/users/7695c0cee5ad4298ad615a3dfb19014c/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:10.658976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.659459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.659936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.701387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] MFA Rules not processed for user `7695c0cee5ad4298ad615a3dfb19014c`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:10.703129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.808415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 943/1881] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:10.815281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.815441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.817033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.917249 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db31bb9-ea25-4704-9805-b0fe1e9b5f94 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.922526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.923156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.923437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.923711 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.924593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.926683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.928543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff821-639d-46f9-b667-d566af689e27 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.935170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.936299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.936790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.937262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] PATH_INFO: `/v3/projects/64ae7cdc79654f6fa41e4dbfaa218dd0` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.939080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ae7cdc79654f6fa41e4dbfaa218dd0)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.941679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.971147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 944/1882] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:10 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:10.972658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.014536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ae7cdc79654f6fa41e4dbfaa218dd0', 'request_id': 'req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.024957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ae7cdc79654f6fa41e4dbfaa218dd0', 'request_id': 'req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.035567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ae7cdc79654f6fa41e4dbfaa218dd0', 'request_id': 'req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.053404 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] The token cache is being invalidate because project 64ae7cdc79654f6fa41e4dbfaa218dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:11.053704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.054424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.056534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 939/1883] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:10 2022] DELETE /identity/v3/projects/64ae7cdc79654f6fa41e4dbfaa218dd0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:11.061416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.063112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.070275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e36aa-615b-4c4c-b590-8dcc08cbc065 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.088305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:11.153773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:11.163930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64fb2f-18e5-4ee6-846a-65cee94c6e96 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.165492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.166344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.166637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.166916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.167732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.170888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.171309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.172289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.172414 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.172659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] PATH_INFO: `/v3/users/03a5959fd3f048a78615c9fa5e3010d5` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.174126 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a5959fd3f048a78615c9fa5e3010d5)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.176685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.212641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 945/1884] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:10 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:11.214237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.216938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.236223 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c455-3f42-4e82-9d4d-159ae795ff5b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.244433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.246768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.247067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.247796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.249638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.252726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.263243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a5959fd3f048a78615c9fa5e3010d5'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.276847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a5959fd3f048a78615c9fa5e3010d5'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.279017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a5959fd3f048a78615c9fa5e3010d5'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.294273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 946/1885] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:11.297626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.298195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a5959fd3f048a78615c9fa5e3010d5'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.299201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a5959fd3f048a78615c9fa5e3010d5'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.311725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390886-6262-4e9f-b962-01737e20d9b6 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.315942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 940/1886] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:11 2022] DELETE /identity/v3/users/03a5959fd3f048a78615c9fa5e3010d5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:11.317701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.318495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.319185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.319415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] PATH_INFO: `/v3/projects/7875d3bff1c64b9da46751cd199204f7/users/70302d5f68134fbab104ed9ca6507a03/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.345342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7875d3bff1c64b9da46751cd199204f7, user_id=70302d5f68134fbab104ed9ca6507a03, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.348732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce730f-facd-4288-9719-7952c7e388b7 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.371381 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 947/1887] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:11 2022] PUT /identity/v3/projects/7875d3bff1c64b9da46751cd199204f7/users/70302d5f68134fbab104ed9ca6507a03/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:11.375500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.377290 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.483449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e829c10-65f7-4b12-96cd-0b2edf3156fe admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.545044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d7e8-a7e0-425a-b9f0-3283fb0e56a9 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.545851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d7e8-a7e0-425a-b9f0-3283fb0e56a9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.546368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d7e8-a7e0-425a-b9f0-3283fb0e56a9 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.550395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 948/1888] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:44:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:44:11.566288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.566995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.567344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.567627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.571504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cff52-2a3a-482a-8309-e6b9196a8cb9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.571946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cff52-2a3a-482a-8309-e6b9196a8cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.572025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cff52-2a3a-482a-8309-e6b9196a8cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.583216 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.590519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.667157 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6c0cff52-2a3a-482a-8309-e6b9196a8cb9 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:11.668898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6c0cff52-2a3a-482a-8309-e6b9196a8cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.679133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 941/1889] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:11.687593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.716947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ce8c-216f-4d28-b0a2-5938aaf0917f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.732335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.734058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.735565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.736428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] PATH_INFO: `/v3/projects/7875d3bff1c64b9da46751cd199204f7/users/70302d5f68134fbab104ed9ca6507a03/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.741496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7875d3bff1c64b9da46751cd199204f7, user_id=70302d5f68134fbab104ed9ca6507a03, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.745794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.795111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 942/1890] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:11 2022] PUT /identity/v3/projects/7875d3bff1c64b9da46751cd199204f7/users/70302d5f68134fbab104ed9ca6507a03/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:11.797183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.801837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.818529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:11.909615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 949/1891] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:11.913685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.914328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.915745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.965811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] MFA Rules not processed for user `70302d5f68134fbab104ed9ca6507a03`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:11.972633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.993895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880b5a1-9685-4b87-93b9-ede680fa73be admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.010401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.011197 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.011482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.011815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] PATH_INFO: `/v3/projects/2a962c1dc36e425482b9e9a62a59f6a8` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.014287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a962c1dc36e425482b9e9a62a59f6a8)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.017160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.090421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:12.115663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a962c1dc36e425482b9e9a62a59f6a8', 'request_id': 'req-696256b0-778e-4294-ab28-ea3a96f6b65c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.129208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a962c1dc36e425482b9e9a62a59f6a8', 'request_id': 'req-696256b0-778e-4294-ab28-ea3a96f6b65c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.136703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 950/1892] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:12.138770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.140594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.151270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a962c1dc36e425482b9e9a62a59f6a8', 'request_id': 'req-696256b0-778e-4294-ab28-ea3a96f6b65c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.181571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd568-5ad7-4546-801c-9bb9aceb7e83 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.181938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] The token cache is being invalidate because project 2a962c1dc36e425482b9e9a62a59f6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:12.182434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.188357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.190442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 943/1893] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:11 2022] DELETE /identity/v3/projects/2a962c1dc36e425482b9e9a62a59f6a8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:12.191049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.192964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.320399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.321072 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.321316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.321609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] PATH_INFO: `/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.322971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e657ed994d8d4a979d2e5bb7a46b0d8e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.323699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696256b0-778e-4294-ab28-ea3a96f6b65c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.330149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.331855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.332465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.332961 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.335117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.340535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.411822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e657ed994d8d4a979d2e5bb7a46b0d8e', 'request_id': 'req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.422210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e657ed994d8d4a979d2e5bb7a46b0d8e', 'request_id': 'req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.425636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:12.449594 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e657ed994d8d4a979d2e5bb7a46b0d8e', 'request_id': 'req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.453161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.455749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.468879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 944/1894] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:12.470086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] The token cache is being invalidate because project e657ed994d8d4a979d2e5bb7a46b0d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:12.470398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.471136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.471902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.473068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 951/1895] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:12 2022] DELETE /identity/v3/projects/e657ed994d8d4a979d2e5bb7a46b0d8e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:12.474030 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.474309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.475502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.506009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb82cf-0113-43bf-ae24-254703b87916 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.639296 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac5e78-ec60-4e1a-b1cd-0fa957f66fd1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.641348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.642030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.642320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.642598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] PATH_INFO: `/v3/users/73e82a3510024ff699e0a0d78c7b9268` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.646351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.647252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.647728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.648188 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.649388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e82a3510024ff699e0a0d78c7b9268)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.650500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.651649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.664071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.666191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5d634-b918-44c2-bed4-73be26b2921e service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.715957 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 952/1896] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:12.717467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b60-e1ad-4173-87ff-650087fb2979 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.717679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b60-e1ad-4173-87ff-650087fb2979 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.725279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b60-e1ad-4173-87ff-650087fb2979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.739812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:12.747705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e82a3510024ff699e0a0d78c7b9268'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.764521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-62c15b60-e1ad-4173-87ff-650087fb2979 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:12.765886 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-62c15b60-e1ad-4173-87ff-650087fb2979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.766228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e82a3510024ff699e0a0d78c7b9268'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.767118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e82a3510024ff699e0a0d78c7b9268'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.782180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 953/1897] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:12.784330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.784625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.784946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.801544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e82a3510024ff699e0a0d78c7b9268'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.804964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e82a3510024ff699e0a0d78c7b9268'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:12.807825 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:12.809122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.822151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 954/1898] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:12.823131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.834454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe205b-6e4c-49c1-b096-ced64c31ce1e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.842646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 945/1899] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:12 2022] DELETE /identity/v3/users/73e82a3510024ff699e0a0d78c7b9268 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:12.842826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.842826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.842826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.842826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.843125 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:12.844328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.845029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.876741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 955/1900] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:12.887876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.029286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacbfaa-cfec-4513-bdb7-e9e8a6cae51d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.034520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.035386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.035671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.035949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.036593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.038668 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.055497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:13.073818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 946/1901] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:12 2022] POST /identity/v3/projects => generated 407 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:13.078851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.091927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca803c-bec8-4fd1-b94d-b2579f2ffd4b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.161901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.162552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.162835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.163109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.163762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.165687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.190754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 956/1902] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:13.195041 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.206324 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1c9d4-876c-4942-ac18-6c72c0d1f061 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.211576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.211945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.212232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.212533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.213199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.216498 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.232261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 947/1903] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:13.236315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.247881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de44f7-dde6-444d-aeec-7732b85a32b1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.252481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.253183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.253810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.254135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.254234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.254406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.255065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.256729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.270563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d7ed6-58a4-4b36-b871-ef0c96f41b12 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.271754 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 957/1904] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:13.275604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.276073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.276782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.276996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.277268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] PATH_INFO: `/v3/projects/69c2b74269704576881b1b066c874ff9` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.279037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c2b74269704576881b1b066c874ff9)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.280949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.292639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa915a-e8bf-46ba-b3cf-1698338d837c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.299818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.300697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.300996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.301455 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] PATH_INFO: `/v3/projects/e66bce17b2cb44b5ba9cb7f4091ae712/users/27d2a3a0f75444af99603ee085724811/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.329294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66bce17b2cb44b5ba9cb7f4091ae712, user_id=27d2a3a0f75444af99603ee085724811, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.336225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e8d2-19e1-4349-b182-108cd24c62f1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.363719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 958/1905] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:13 2022] PUT /identity/v3/projects/e66bce17b2cb44b5ba9cb7f4091ae712/users/27d2a3a0f75444af99603ee085724811/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:13.375171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.375465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.375737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.389119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c2b74269704576881b1b066c874ff9', 'request_id': 'req-092105c6-f070-486c-bd00-1c9967a56fd0'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:13.403239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c2b74269704576881b1b066c874ff9', 'request_id': 'req-092105c6-f070-486c-bd00-1c9967a56fd0'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:13.422933 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c2b74269704576881b1b066c874ff9', 'request_id': 'req-092105c6-f070-486c-bd00-1c9967a56fd0'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:13.442206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] MFA Rules not processed for user `27d2a3a0f75444af99603ee085724811`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:13.443510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.453038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] The token cache is being invalidate because project 69c2b74269704576881b1b066c874ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:13.453335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:13.456530 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-092105c6-f070-486c-bd00-1c9967a56fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:13.462879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 948/1906] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:13 2022] DELETE /identity/v3/projects/69c2b74269704576881b1b066c874ff9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:13.470353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecbe-4cbb-4759-a8b8-b50256881907 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.470760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecbe-4cbb-4759-a8b8-b50256881907 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.471211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eecbe-4cbb-4759-a8b8-b50256881907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.546755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a52eecbe-4cbb-4759-a8b8-b50256881907 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:13.552519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a52eecbe-4cbb-4759-a8b8-b50256881907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.641117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 959/1907] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:13.649913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.652317 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.703938 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 949/1908] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:13.712298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.713074 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.713588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.723449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:13.772417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:13.775739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.795990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 950/1909] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:13.798004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.802094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.832284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209ca41-1ab3-47fe-8012-66a3bc1d838a None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:13.843440 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:13.843655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.843895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.844149 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.844812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:13.846789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:13.908716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 960/1910] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/projects => generated 407 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:13.909753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:13.965681 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4521a78-3c65-47c5-8e02-5260459d107f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.000024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:14.084805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56e86-9c71-4637-91a0-6fe34a49559a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.107095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.107689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.107841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.108037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.108315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.109533 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.109823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.110127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.110390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:14.117271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:14.117591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.123009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.145510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 961/1911] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:14.146771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.160798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807255-a23a-4900-9412-16065a0b4348 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.168726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.171822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.172561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.172895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.174099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.178292 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.222232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 962/1912] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:14 2022] POST /identity/v3/users => generated 310 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:14.223192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.226589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:14.234854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.238761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.247999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9491dc1-b3d0-4d39-b438-da863ab5ea43 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.254761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.256272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.257104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 951/1913] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:14.258640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.270741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.270741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.278745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b620e6-30bb-4eaf-b3d3-7ca6c656a3be service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.281362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:14.290504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.291813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.296237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.296803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.297796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.305576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.401013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 952/1914] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:14 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:14.401013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.437269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.440154 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.462674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 963/1915] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:14.463435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.483844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2866-2abe-47c9-801d-f5d503a2becf service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.501481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:14.551806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d120-eea9-4dd2-9a49-021b2fc6eaa9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.565370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.567005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.567963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.568774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.570683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.590615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.624890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.625833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.626288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.626710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.627657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.631122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.643964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 953/1916] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:14.646389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.709498 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 964/1917] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:14 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:14.714690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b3df-88b2-4660-8c3a-a5b512091bd0 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.717444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.719169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.719848 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.720132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.720467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] PATH_INFO: `/v3/projects/9a0689d2d9064ec690e92e2173d498f9/users/491331feca8d4aa1bcc128adc7ac144a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.754079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f9469-98cd-4ef7-a5e0-93f977ba57e3 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.763388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0689d2d9064ec690e92e2173d498f9, user_id=491331feca8d4aa1bcc128adc7ac144a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.785525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.785525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.785525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.785525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.785861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.785861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.787860 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.805444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 965/1918] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:14.810185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.821800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04087d2-5d65-42ff-9fb8-4a4ee2aede42 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.840852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 954/1919] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:14 2022] PUT /identity/v3/projects/9a0689d2d9064ec690e92e2173d498f9/users/491331feca8d4aa1bcc128adc7ac144a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:14.844706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.875804 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:14.915946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.918352 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.919641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.920579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.923706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:14.930378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:14.952715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 966/1920] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:14.957776 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:14.987670 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8935ae-a086-45c1-8319-daf0865189a6 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:14.994041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:14.995211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:14.995631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:14.996837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] PATH_INFO: `/v3/projects/2422f190756d44e4a821b98023223369/users/c57e1605f7844cf8ab072bbab25d48a0/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:14.999386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8d51-18df-4c1e-b4aa-221458c60453 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.014494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.015418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.016584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.018760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.019683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.023879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.032221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2422f190756d44e4a821b98023223369, user_id=c57e1605f7844cf8ab072bbab25d48a0, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.037851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc000a-dbad-44d1-892c-6baee0199d40 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.046557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 955/1921] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:15.053081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.068893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 967/1922] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:14 2022] PUT /identity/v3/projects/2422f190756d44e4a821b98023223369/users/c57e1605f7844cf8ab072bbab25d48a0/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:15.081697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.089679 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.090075 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.095789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6636a-7c39-4c20-984b-cfd0df1c8122 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.149683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] MFA Rules not processed for user `c57e1605f7844cf8ab072bbab25d48a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:15.162869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:15.228120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.229034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.229149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.229342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] PATH_INFO: `/v3/projects/9a0689d2d9064ec690e92e2173d498f9/users/491331feca8d4aa1bcc128adc7ac144a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.233272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0689d2d9064ec690e92e2173d498f9, user_id=491331feca8d4aa1bcc128adc7ac144a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.235960 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac41c24-d29c-43be-a912-15028e5648f7 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.274815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 956/1923] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:15 2022] PUT /identity/v3/projects/9a0689d2d9064ec690e92e2173d498f9/users/491331feca8d4aa1bcc128adc7ac144a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:15.287564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.289627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.289907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.334117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:15.353749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] MFA Rules not processed for user `491331feca8d4aa1bcc128adc7ac144a`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:15.355248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:15.375404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 968/1924] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:15.392866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.428156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199beaa-aec6-450f-b9ad-a3522b445b1b None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.538997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 957/1925] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:15.562687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.614702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.616202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.616487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.616773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.617431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.619388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.623187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:15.656903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e3dba-9feb-495a-9ede-f1d37eea67ab None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.663394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.664360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.664965 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.665525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.680970 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 969/1926] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:15 2022] POST /identity/v3/projects => generated 363 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:15.686881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.698911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.702033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.722455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 958/1927] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:15 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:15.812954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7801f85-9ddd-4f4e-97a9-95052733f469 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.820305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.821025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.821311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.821592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.826663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.826663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.861658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 970/1928] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:15 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:15.862773 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.887702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffee3-1858-4250-9581-171e60ff9d34 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.897380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.898234 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.898526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.898823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.899752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.902789 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:15.920255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 959/1929] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:15.931928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.942855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:15.945994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9426-3e34-4488-b2dc-5a123f66446d admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:15.956635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:15.959656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:15.960362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:15.961029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] PATH_INFO: `/v3/projects/ddb3516004834dd5910837fe21faffa2/users/63f9d63e8bda46feb40c79db35404995/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:15.987941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb3516004834dd5910837fe21faffa2, user_id=63f9d63e8bda46feb40c79db35404995, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:15.992141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.010505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 971/1930] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:15 2022] PUT /identity/v3/projects/ddb3516004834dd5910837fe21faffa2/users/63f9d63e8bda46feb40c79db35404995/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:16.015614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:16.025241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379072a-c04e-41cc-86c3-0dd3e6e150ff admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:16.090413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:16.090578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.091000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.091386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.093102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:16.115283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409027fb-b080-48e2-91f2-654be778bf80 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:16.121881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:16.122669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.123012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.123356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.124523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:16.125823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.141910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 972/1931] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:16.142827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:16.153319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73421e-f568-48f3-b6d5-1e71181f354a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:16.158818 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:16.159503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.159780 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.160054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] PATH_INFO: `/v3/projects/ddb3516004834dd5910837fe21faffa2/users/63f9d63e8bda46feb40c79db35404995/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.162083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb3516004834dd5910837fe21faffa2, user_id=63f9d63e8bda46feb40c79db35404995, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:16.164752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.175432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:16.177288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa911bd-2048-4bef-aa56-88bade430ba4 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.197205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 960/1932] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:15 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:16.206304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 973/1933] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:16 2022] PUT /identity/v3/projects/ddb3516004834dd5910837fe21faffa2/users/63f9d63e8bda46feb40c79db35404995/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:16.207664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.207981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.208264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.271027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] MFA Rules not processed for user `63f9d63e8bda46feb40c79db35404995`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:16.274866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:16.330901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:16.395457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 961/1934] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:16.409310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:16.481846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe73f3-4b6c-41df-8d6c-adec7395ba30 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:16.486410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:16.487032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.487318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.487597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.499188 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:16.501173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.515800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 974/1935] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:16.624665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:16.635502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de1318-3051-4dc3-afcc-f236f777f575 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:16.639195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:16.639810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:16.640110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:16.640379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:16.702172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:16.703621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfca43a-d080-4a69-94fd-4b320e9296a6 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:16.712896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 962/1936] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:17.251949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:17.254253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:17.323938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eab8b-ae0b-437b-bee6-4188290bb0c0 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:17.329190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:17.329822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:17.330146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:17.330422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] PATH_INFO: `/v3/users/cfc64cdfbc4f42809d9cae66dfcd6298` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:17.331566 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc64cdfbc4f42809d9cae66dfcd6298)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:17.333477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:17.416707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc64cdfbc4f42809d9cae66dfcd6298'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:17.430615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc64cdfbc4f42809d9cae66dfcd6298'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:17.446129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc64cdfbc4f42809d9cae66dfcd6298'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:17.457985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc64cdfbc4f42809d9cae66dfcd6298'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:17.457985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc64cdfbc4f42809d9cae66dfcd6298'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:17.460638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:17.481620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 975/1937] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:17 2022] DELETE /identity/v3/users/cfc64cdfbc4f42809d9cae66dfcd6298 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:17.486282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69971385-732d-4a3c-8247-519eacd8530e None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:17.486785 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69971385-732d-4a3c-8247-519eacd8530e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:17.489329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69971385-732d-4a3c-8247-519eacd8530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:17.514400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-69971385-732d-4a3c-8247-519eacd8530e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:17.515687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-69971385-732d-4a3c-8247-519eacd8530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:17.704839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 963/1938] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:17.722553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:17.728269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:17.817322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5000ed-ac96-4e20-860e-408d55129220 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:17.822102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:17.822774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:17.823056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:17.823329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:17.835368 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:17.837156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:17.851489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 976/1939] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:18.254158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69971385-732d-4a3c-8247-519eacd8530e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:18.255811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-69971385-732d-4a3c-8247-519eacd8530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:18.272420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69971385-732d-4a3c-8247-519eacd8530e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:18.279296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:18.280172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:18.280603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:18.281135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] PATH_INFO: `/v3/projects/ccd208a60c6d46439a578fdc1d8a1291` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:18.283739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd208a60c6d46439a578fdc1d8a1291)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:18.286282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:18.357173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd208a60c6d46439a578fdc1d8a1291', 'request_id': 'req-57b26dd7-4757-45a8-a9a8-33d52c62624e'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.372730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd208a60c6d46439a578fdc1d8a1291', 'request_id': 'req-57b26dd7-4757-45a8-a9a8-33d52c62624e'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.377046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:18.389385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd208a60c6d46439a578fdc1d8a1291', 'request_id': 'req-57b26dd7-4757-45a8-a9a8-33d52c62624e'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.426465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] The token cache is being invalidate because project ccd208a60c6d46439a578fdc1d8a1291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:18.426465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.426465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.426465 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 964/1940] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:18 2022] DELETE /identity/v3/projects/ccd208a60c6d46439a578fdc1d8a1291 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:18.426775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:18.437370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee14d-2a10-4bcf-aa82-6bde5da1af7c service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:18.514096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:18.514879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:18.515179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:18.515499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] PATH_INFO: `/v3/users/ac796851a0df4c1c96552735379cffe3` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:18.516834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac796851a0df4c1c96552735379cffe3)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:18.519601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:18.571178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac796851a0df4c1c96552735379cffe3'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.580839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac796851a0df4c1c96552735379cffe3'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.613277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac796851a0df4c1c96552735379cffe3'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.623185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac796851a0df4c1c96552735379cffe3'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.624009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c31990af-20d5-4f34-b896-cfa8a28470b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac796851a0df4c1c96552735379cffe3'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.640035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 977/1941] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:18 2022] DELETE /identity/v3/users/ac796851a0df4c1c96552735379cffe3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:18.661245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:18.662913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:18.686635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b26dd7-4757-45a8-a9a8-33d52c62624e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:18.793086 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:18.793845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:18.794182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:18.794459 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] PATH_INFO: `/v3/users/7695c0cee5ad4298ad615a3dfb19014c` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:18.795921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7695c0cee5ad4298ad615a3dfb19014c)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:18.798002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:18.921167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7695c0cee5ad4298ad615a3dfb19014c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.934486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7695c0cee5ad4298ad615a3dfb19014c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.935142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7695c0cee5ad4298ad615a3dfb19014c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.971755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7695c0cee5ad4298ad615a3dfb19014c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:18.973188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7695c0cee5ad4298ad615a3dfb19014c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.011971 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 965/1942] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:18 2022] DELETE /identity/v3/users/7695c0cee5ad4298ad615a3dfb19014c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:19.016336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:19.016634 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:19.016916 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:19.055075 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:19.056398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:19.076168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:19.223922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 978/1943] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:19.235413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:19.242502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:19.343878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:19.346293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:19.373171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2aa1c-85fb-41ba-abaf-0447caed8f54 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:19.379326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:19.379994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:19.380336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:19.380611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] PATH_INFO: `/v3/projects/eca20d0577cf48eea55c4a379280a628` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:19.381888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca20d0577cf48eea55c4a379280a628)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:19.382550 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4e5f-90d6-4a12-aa92-f92d3e29ed1e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:19.384506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:19.397289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:19.397951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:19.398431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:19.398787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:19.411396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:19.414078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:19.427341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 966/1944] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:19.476783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca20d0577cf48eea55c4a379280a628', 'request_id': 'req-638b5cda-a6e8-4b08-8c7b-ffb807306f14'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.489934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca20d0577cf48eea55c4a379280a628', 'request_id': 'req-638b5cda-a6e8-4b08-8c7b-ffb807306f14'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.529601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca20d0577cf48eea55c4a379280a628', 'request_id': 'req-638b5cda-a6e8-4b08-8c7b-ffb807306f14'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.561926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] The token cache is being invalidate because project eca20d0577cf48eea55c4a379280a628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:19.562274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.563191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.567310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 979/1945] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:19 2022] DELETE /identity/v3/projects/eca20d0577cf48eea55c4a379280a628 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:19.572365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:19.589081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9980-1d1d-45e1-973f-ed801431314e service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:19.597691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:19.700067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:19.700796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:19.701723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:19.702126 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] PATH_INFO: `/v3/users/0d6a84a0f933488d892b87e6a2a7c151` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:19.703537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6a84a0f933488d892b87e6a2a7c151)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:19.708734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:19.813693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6a84a0f933488d892b87e6a2a7c151'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.828984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6a84a0f933488d892b87e6a2a7c151'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.830639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6a84a0f933488d892b87e6a2a7c151'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.863203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6a84a0f933488d892b87e6a2a7c151'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.864285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6a84a0f933488d892b87e6a2a7c151'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:19.880936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 967/1946] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:19 2022] DELETE /identity/v3/users/0d6a84a0f933488d892b87e6a2a7c151 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:19.883425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:19.884840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:19.899942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b5cda-a6e8-4b08-8c7b-ffb807306f14 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:20.044506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:20.045892 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.046968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.047303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] PATH_INFO: `/v3/projects/590222702b814f20b62aead3f98428e7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.049306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=590222702b814f20b62aead3f98428e7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:20.051982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:20.119767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:20.133830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590222702b814f20b62aead3f98428e7', 'request_id': 'req-cdcd04a5-c31d-4b89-9214-a9f950153faf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.148729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590222702b814f20b62aead3f98428e7', 'request_id': 'req-cdcd04a5-c31d-4b89-9214-a9f950153faf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.158480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590222702b814f20b62aead3f98428e7', 'request_id': 'req-cdcd04a5-c31d-4b89-9214-a9f950153faf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.181126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] The token cache is being invalidate because project 590222702b814f20b62aead3f98428e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:20.181877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.182883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.186598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 980/1947] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:19 2022] DELETE /identity/v3/projects/590222702b814f20b62aead3f98428e7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:20.190494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.192076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:20.239904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c98d1-3427-41f3-bbfc-c0589ccdb027 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:20.360680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:20.361580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.362063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.362541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] PATH_INFO: `/v3/users/70302d5f68134fbab104ed9ca6507a03` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.365904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70302d5f68134fbab104ed9ca6507a03)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:20.370787 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:20.432885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.434454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:20.456090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:20.457582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd04a5-c31d-4b89-9214-a9f950153faf admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:20.466785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:20.468234 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.469009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.469480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] PATH_INFO: `/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.471832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2731926e4a6d44bda573dd9d5fd0ffdd)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:20.474364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:20.490309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70302d5f68134fbab104ed9ca6507a03'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.502581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70302d5f68134fbab104ed9ca6507a03'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.503830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70302d5f68134fbab104ed9ca6507a03'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.526705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70302d5f68134fbab104ed9ca6507a03'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.530518 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-956d268d-ac2d-4aa4-b9ea-54821fef4ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70302d5f68134fbab104ed9ca6507a03'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.547715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 968/1948] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:20 2022] DELETE /identity/v3/users/70302d5f68134fbab104ed9ca6507a03 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:20.592226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2731926e4a6d44bda573dd9d5fd0ffdd', 'request_id': 'req-be918b70-857d-4def-b3c1-c1b0537d4d50'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.604609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2731926e4a6d44bda573dd9d5fd0ffdd', 'request_id': 'req-be918b70-857d-4def-b3c1-c1b0537d4d50'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.613394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2731926e4a6d44bda573dd9d5fd0ffdd', 'request_id': 'req-be918b70-857d-4def-b3c1-c1b0537d4d50'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.644090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] The token cache is being invalidate because project 2731926e4a6d44bda573dd9d5fd0ffdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:20.644399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.645913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-be918b70-857d-4def-b3c1-c1b0537d4d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:20.648132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 981/1949] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:20 2022] DELETE /identity/v3/projects/2731926e4a6d44bda573dd9d5fd0ffdd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:20.655677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d821-7632-4738-a808-40070ea843c1 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.656037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d821-7632-4738-a808-40070ea843c1 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.656340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d821-7632-4738-a808-40070ea843c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.695289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7396d821-7632-4738-a808-40070ea843c1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:20.696727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7396d821-7632-4738-a808-40070ea843c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:20.790122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 969/1950] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:20.794588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.794879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.795159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.815406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:20.816629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:20.829579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 982/1951] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:20.834676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396d821-7632-4738-a808-40070ea843c1 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.848513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396d821-7632-4738-a808-40070ea843c1 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:20.854104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:20.855164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.857230 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.857685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.858526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:20.858976 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:20.860752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:20.878379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 970/1952] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:20.883405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.895183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96891a4-b875-4eb0-b148-6f041874d538 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:20.900342 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:20.900978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:20.901261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:20.901530 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:20.902276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:20.904329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:20.950681 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 983/1953] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:20 2022] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:20.956147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.963048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:20.966656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:20.981984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1ab19-aadb-45d7-a1f6-c5c9952eb3ab admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.068191 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393ab8b-e74c-4287-9f3b-c8f411e1bf58 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.075258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.075787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.076099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.076382 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] PATH_INFO: `/v3/projects/7875d3bff1c64b9da46751cd199204f7` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.077865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7875d3bff1c64b9da46751cd199204f7)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.080951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.092483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.093110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.093390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.093661 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.094340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.097080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.118951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:21.139615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 971/1954] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:20 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:21.142912 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.159887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdcd9a-fc54-43ac-b308-5f4cde8a3843 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.175308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7875d3bff1c64b9da46751cd199204f7', 'request_id': 'req-d18322b7-7382-4c59-8cb3-67fa6221bdc8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:21.185660 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7875d3bff1c64b9da46751cd199204f7', 'request_id': 'req-d18322b7-7382-4c59-8cb3-67fa6221bdc8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:21.194946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:21.197319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7875d3bff1c64b9da46751cd199204f7', 'request_id': 'req-d18322b7-7382-4c59-8cb3-67fa6221bdc8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:21.222513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] The token cache is being invalidate because project 7875d3bff1c64b9da46751cd199204f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:21.223146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:21.224024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-d18322b7-7382-4c59-8cb3-67fa6221bdc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:21.227658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 984/1955] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:20 2022] DELETE /identity/v3/projects/7875d3bff1c64b9da46751cd199204f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:21.234622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.234758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.235185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.267891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.268526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.268906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.269082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.269740 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.270893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:21.271508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f122d-37d3-42d6-ac7b-3000fb223bc8 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.272906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:21.290420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 985/1956] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:21.298449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 972/1957] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:21.311466 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.312918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:21.315392 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.315888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.316486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.329280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646a684-7810-43ff-8632-2f95a278d582 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.335265 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.337145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.338151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.338741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.340685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.344088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.349634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:21.352014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:21.359080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 986/1958] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:21.363059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.367881 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 973/1959] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:21.369811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.374194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799397-ff8b-447f-940d-9465bb68d804 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.379529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.380436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.380900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.381384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] PATH_INFO: `/v3/projects/fae0dfe232124836ad1cecc3c4d5775d/users/2f185b0b11254019934abcb538ef1d2c/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.383368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b776-1b30-4a79-a6b2-a2b8e376f44a None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.390009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.390641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.390930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.391932 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.392615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:21.393357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.396035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.400839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae0dfe232124836ad1cecc3c4d5775d, user_id=2f185b0b11254019934abcb538ef1d2c, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.404431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae0016-bfa1-4d50-9a31-05c34c23d2ad admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.419666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 974/1960] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:21.422002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.436505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa8115-fae6-458b-a49d-c479d66671ac admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.437014 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 987/1961] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:21 2022] PUT /identity/v3/projects/fae0dfe232124836ad1cecc3c4d5775d/users/2f185b0b11254019934abcb538ef1d2c/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:21.439115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.439404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.439705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.480874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] MFA Rules not processed for user `2f185b0b11254019934abcb538ef1d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:21.482144 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:21.508223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.510079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.510600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.511045 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.512526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.515307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.552513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 975/1962] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:21.553851 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.556220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 988/1963] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:21.560838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.573752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4f6f-31d7-4372-ae28-43819d97f9d3 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.654693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e43388-6ba4-40b2-a3f2-f19a2aed5b30 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.659672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.660492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.660847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.661184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.662042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.664069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.667454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.668968 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.669253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.669527 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.670244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.678990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.693143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:21.706009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 976/1964] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:21.710551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.723926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e460-a766-4ee6-9761-a0dd7999f789 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.729896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.731387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.733043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.733043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.733043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.735058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.745044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 989/1965] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/projects => generated 399 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:21.747009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.755533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 977/1966] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:21.758275 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.769536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:21.780148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29a67-a883-45b1-a830-dcfe1722a911 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.878982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe916e-95c8-41ac-b571-0f6a344c1cbe admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.879190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.879802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.880077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.880363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.881024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.882899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.888295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.889477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.889477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.890222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.890888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.892993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.897700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 978/1967] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:21.898797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.916347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c575-83f6-4af1-9e3d-0970c0d16757 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.921746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.922524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.923044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.926059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 990/1968] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/users => generated 306 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:21.929762 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.934737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] PATH_INFO: `/v3/projects/c60b2fe09e2e41009d1fb42eaa0ec5b6/users/47f0fee18e704b8e8de43ff5c5f3bdce/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.941647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ea47-c0e3-4534-a69a-52c3b614fcf8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.947480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:21.947971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.948894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.950065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:21.950840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.952526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.959169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60b2fe09e2e41009d1fb42eaa0ec5b6, user_id=47f0fee18e704b8e8de43ff5c5f3bdce, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:21.962331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332204c4-ed8c-4d62-b1a0-42381d65019f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:21.966015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 991/1969] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:21.967495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:21.979939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef64c0-301d-43e6-bafe-defc9c92e7db admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:21.984563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 979/1970] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:21 2022] PUT /identity/v3/projects/c60b2fe09e2e41009d1fb42eaa0ec5b6/users/47f0fee18e704b8e8de43ff5c5f3bdce/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:21.995782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:21.996593 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:21.996875 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.037222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] MFA Rules not processed for user `47f0fee18e704b8e8de43ff5c5f3bdce`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:22.038486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:22.055822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.056598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.057005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.057359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] PATH_INFO: `/v3/projects/94616f222a374663aa90501cbf89e540/users/abc9482ffb6a43b3bcb6bff566d52968/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.101994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94616f222a374663aa90501cbf89e540, user_id=abc9482ffb6a43b3bcb6bff566d52968, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.105177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.133474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 992/1971] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:21 2022] PUT /identity/v3/projects/94616f222a374663aa90501cbf89e540/users/abc9482ffb6a43b3bcb6bff566d52968/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:22.139066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.168899 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 980/1972] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:22.173210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.196768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47f63-bbff-4a25-9bf9-b95d9b3ad30b None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.244801 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:22.268010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d674-4b66-465e-85ff-ba4e8a7f9d7e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.274402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.275465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.275856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.276275 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.277026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.278926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.291369 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 993/1973] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:22.296618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.306741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.307725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.308231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.309507 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.310421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.312672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.323767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:22.327503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3277ba-ff7f-40e0-9e0a-9c9a5374fbef admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.342631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.343402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.343506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.343787 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] PATH_INFO: `/v3/projects/94616f222a374663aa90501cbf89e540/users/abc9482ffb6a43b3bcb6bff566d52968/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.346447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=94616f222a374663aa90501cbf89e540, user_id=abc9482ffb6a43b3bcb6bff566d52968, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.351331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.353172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 981/1974] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:22 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:22.353919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.359389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:22.377912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 994/1975] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:22 2022] PUT /identity/v3/projects/94616f222a374663aa90501cbf89e540/users/abc9482ffb6a43b3bcb6bff566d52968/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:22.388633 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.466595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9cb5e-33e1-4e99-8518-47e3ad07cfbe admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.495207 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8d6f-323d-4da9-81b9-0a96cb5874fa admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.516432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.517058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.517348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.517625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.518348 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.521393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318dbe2-24ee-4e0c-b56a-f907f3af3ade admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.562449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 995/1976] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:22 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:22.564581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.565134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.565606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.597118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.597810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.598311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.598591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] PATH_INFO: `/v3/users/27d2a3a0f75444af99603ee085724811` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.599769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d2a3a0f75444af99603ee085724811)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.601952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.606878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] MFA Rules not processed for user `abc9482ffb6a43b3bcb6bff566d52968`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:22.607932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:22.721362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 996/1977] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:22.722365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.728809 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d2a3a0f75444af99603ee085724811'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:22.740913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ddb65-3833-4122-b627-415b6c483977 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.744521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d2a3a0f75444af99603ee085724811'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:22.746605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d2a3a0f75444af99603ee085724811'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:22.749219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.749878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.750486 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.750595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.751318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:22.752973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:22.783522 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 997/1978] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:22.784363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.787866 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d2a3a0f75444af99603ee085724811'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:22.788902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:22.789134 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d2a3a0f75444af99603ee085724811'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:22.809133 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 982/1979] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:22 2022] DELETE /identity/v3/users/27d2a3a0f75444af99603ee085724811 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:22.813761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:22.815490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:22.850894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:22.878315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:22.927287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e4b-0e93-45b1-8a73-444450e5bde2 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.979218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ef30-5ef2-42b4-909c-69e8d6422e27 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:22.995461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:22.996390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:22.996823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:22.997248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:22.998160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.002856 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bdd04-879a-46cd-945f-26242bd4a833 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.025936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 983/1980] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:23.033551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.033869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.038242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.051848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.054092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.054828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.057024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.061612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.065023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:23.066255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.085250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 984/1981] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:23.086343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.104066 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09e8f7-d49c-44bf-bca2-1a11546d791a None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.111304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.113103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.113812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.113931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] PATH_INFO: `/v3/projects/faaa2493a3284fbda761e4f66e6e9714/users/87b9446e46f64c6cac25ed8bd600f424/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.137427 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaa2493a3284fbda761e4f66e6e9714, user_id=87b9446e46f64c6cac25ed8bd600f424, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.141288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.171391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 985/1982] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:23 2022] PUT /identity/v3/projects/faaa2493a3284fbda761e4f66e6e9714/users/87b9446e46f64c6cac25ed8bd600f424/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:23.171391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.182638 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.212087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.216962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24e002-e9a5-4a56-a5cd-4884ccc65da3 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.243491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 998/1983] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:22 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:23.245637 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.246622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.246963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.293675 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf2274-83d3-4775-8293-290ac2e7be3c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.300850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.301502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.301790 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.302110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.308032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] MFA Rules not processed for user `87b9446e46f64c6cac25ed8bd600f424`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:23.309407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.423634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.425358 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.437612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 986/1984] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:23.438923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.440564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.454364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 999/1985] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:23.461420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.475936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727320f-40f5-4c4e-a6e0-9880fe8fe201 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.481726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.482503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.482694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.483087 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.483816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.486431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.498124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:23.531824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479fc7-2802-4362-9cae-8c04cabdc8a8 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.535729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.536348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.537381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.540931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.542735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1000/1986] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:23 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:23.543566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:23.544706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.557891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:23.632227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.633598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.639557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e1f6f-0414-4b37-a15d-6e16e23f1186 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.644491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 987/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:23.648293 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.649282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.649946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.650449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.651235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.653545 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.686926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1001/1988] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:23 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:23.687843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.701433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901f34-ecec-4596-b398-5ff2039d8427 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.713068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.713705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.714000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.714279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.715035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.716645 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.742864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 988/1989] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:23.745073 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.787357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbf07-45c4-4103-ac61-3a47e2cfe9c8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.794714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.796378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.797026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.797483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] PATH_INFO: `/v3/projects/f8104183da934342b285382f0b710d71/users/bb6ce89a2b254ec89d2108daf2bdbffb/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.827650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8104183da934342b285382f0b710d71, user_id=bb6ce89a2b254ec89d2108daf2bdbffb, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:23.835142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:23.865283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1002/1990] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:23 2022] PUT /identity/v3/projects/f8104183da934342b285382f0b710d71/users/bb6ce89a2b254ec89d2108daf2bdbffb/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:23.869323 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:23.894511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703754b3-0136-4472-a779-287fea6fa7d5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:23.996672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:23.998409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:23.998409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:23.998409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:23.999896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.002480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bd88-a876-4c95-9158-80d0bdbda79c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.022130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 989/1991] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:24.023429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:24.045061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6356a6a-18e1-4e2e-b293-8c3734cf9ffe admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:24.051215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:24.052316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.052828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.053344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] PATH_INFO: `/v3/projects/f8104183da934342b285382f0b710d71/users/bb6ce89a2b254ec89d2108daf2bdbffb/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.072502 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8104183da934342b285382f0b710d71, user_id=bb6ce89a2b254ec89d2108daf2bdbffb, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.079489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.131492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.131812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.132093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.143939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1003/1992] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:24 2022] PUT /identity/v3/projects/f8104183da934342b285382f0b710d71/users/bb6ce89a2b254ec89d2108daf2bdbffb/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:24.146611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:24.151765 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:24.197693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] MFA Rules not processed for user `bb6ce89a2b254ec89d2108daf2bdbffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:24.199558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:24.297457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:24.310758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 990/1993] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:24.323451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416372b-963e-4191-9609-a220535302c4 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:24.331200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:24.331974 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.332326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.332712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] PATH_INFO: `/v3/projects/e66bce17b2cb44b5ba9cb7f4091ae712` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.336478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66bce17b2cb44b5ba9cb7f4091ae712)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.341750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.417376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66bce17b2cb44b5ba9cb7f4091ae712', 'request_id': 'req-80962ec8-67bd-4d17-b813-f443bd2f505c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.425741 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66bce17b2cb44b5ba9cb7f4091ae712', 'request_id': 'req-80962ec8-67bd-4d17-b813-f443bd2f505c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.427939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:24.438445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66bce17b2cb44b5ba9cb7f4091ae712', 'request_id': 'req-80962ec8-67bd-4d17-b813-f443bd2f505c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.471214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] The token cache is being invalidate because project e66bce17b2cb44b5ba9cb7f4091ae712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:24.471524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.475288 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.482737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:24.490069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1004/1994] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:24 2022] DELETE /identity/v3/projects/e66bce17b2cb44b5ba9cb7f4091ae712 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:24.491141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:24.492809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:24.503056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c969b-057f-46dd-94c6-3ccf5bb2db42 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:24.568553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962ec8-67bd-4d17-b813-f443bd2f505c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:24.576220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:24.576848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.577132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.577408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.580193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:24.610119 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:24.611767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.612442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.612874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] PATH_INFO: `/v3/users/491331feca8d4aa1bcc128adc7ac144a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.615127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491331feca8d4aa1bcc128adc7ac144a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.619193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.706559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.709584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.727608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491331feca8d4aa1bcc128adc7ac144a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.741738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1005/1995] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:24.747826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491331feca8d4aa1bcc128adc7ac144a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.749130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491331feca8d4aa1bcc128adc7ac144a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.773580 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491331feca8d4aa1bcc128adc7ac144a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.774648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491331feca8d4aa1bcc128adc7ac144a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:24.811674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 991/1996] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:24 2022] DELETE /identity/v3/users/491331feca8d4aa1bcc128adc7ac144a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:24.811894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:24.820703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493700ce-1f8a-43b6-be60-1ce727752402 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:24.884007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:24.884738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:24.885205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:24.885832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:24.888963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:24.960579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:24.968318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:24.971845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ec77-9266-4502-a3fb-16597f13c872 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:24.986896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1006/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:25.147594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.150065 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.269293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947b2b-aa00-4ca4-81a9-1571e8aa1752 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:25.287818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:25.288495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.288778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.289055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] PATH_INFO: `/v3/projects/9a0689d2d9064ec690e92e2173d498f9` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.295996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0689d2d9064ec690e92e2173d498f9)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:25.298309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:25.340628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:25.372922 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0689d2d9064ec690e92e2173d498f9', 'request_id': 'req-a54d437f-c76f-4c7b-850f-2219df722ed4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.384366 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0689d2d9064ec690e92e2173d498f9', 'request_id': 'req-a54d437f-c76f-4c7b-850f-2219df722ed4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.399859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0689d2d9064ec690e92e2173d498f9', 'request_id': 'req-a54d437f-c76f-4c7b-850f-2219df722ed4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.430372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] The token cache is being invalidate because project 9a0689d2d9064ec690e92e2173d498f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:25.430945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.432791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a54d437f-c76f-4c7b-850f-2219df722ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.436048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 992/1998] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:25 2022] DELETE /identity/v3/projects/9a0689d2d9064ec690e92e2173d498f9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:25.441264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.441354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.441578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.473262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:25.474587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.617306 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.617699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.618102 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.622695 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1007/1999] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:25.651472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:25.654512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.658161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.660616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.669461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 993/2000] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:25.674250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.676367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c95007-9720-4bc7-9af1-9a4b0e840fc4 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:25.686299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:25.687180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.687605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.687984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] PATH_INFO: `/v3/users/c57e1605f7844cf8ab072bbab25d48a0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.688280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1f440-d373-4921-b465-d645d8bb843d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:25.691399 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57e1605f7844cf8ab072bbab25d48a0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:25.693218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:25.693475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:25.693834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.694173 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.694450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.697751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:25.697751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:25.700087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:25.716555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 994/2001] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:44:25.721889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.737318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd34b-f5fa-43b5-a237-7ed019ba8193 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:25.742690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:25.743315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.743578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.743854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.745405 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:25.748255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:25.756092 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57e1605f7844cf8ab072bbab25d48a0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.769454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57e1605f7844cf8ab072bbab25d48a0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.787971 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 995/2002] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:25 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:25.790203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.795482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57e1605f7844cf8ab072bbab25d48a0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.796500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57e1605f7844cf8ab072bbab25d48a0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.797303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f298a0b3-5150-42fc-9e33-a978956321ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57e1605f7844cf8ab072bbab25d48a0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:25.822648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1008/2003] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:25 2022] DELETE /identity/v3/users/c57e1605f7844cf8ab072bbab25d48a0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:25.824739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:25.825883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:25.825883 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:25.868538 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:25.872193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.941531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f05d62-94b5-4cf3-b6c6-08a68e9fed61 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:25.954820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1009/2004] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:25.967268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:25.970481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:25.982345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:26.016627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.017271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.017563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.017836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.018526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.020783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.047372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:26.062439 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 996/2005] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:25 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:26.063529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.070970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:26.081750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d285346-a5bf-42e8-ad44-84493ae2283f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.086676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366a4cb-c928-4ba1-a523-1b43fe9832e3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.092485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.094002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.094555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.095034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.096282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.098370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.104037 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.104693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.106377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.106774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.115600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 997/2006] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:26.116762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.122313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.123805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.133337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf33887-7b46-400d-a66f-f8f3871109e3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.135959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1010/2007] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:26.138744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.139375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.139662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.139940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.140602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.143754 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32afc74-7e71-43d4-a33c-0a5b7fb8e8b0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.164821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 998/2008] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:26.170333 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.185930 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52a89-cc71-4f5f-9d46-066d125f7672 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.210479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.211286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.211680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.212076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] PATH_INFO: `/v3/projects/ce25df64dac24429886a003cf84d32c9/users/84b4d156ce154f5fb5d516afb278cb15/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.245102 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce25df64dac24429886a003cf84d32c9, user_id=84b4d156ce154f5fb5d516afb278cb15, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.248556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.269507 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1011/2009] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:26 2022] PUT /identity/v3/projects/ce25df64dac24429886a003cf84d32c9/users/84b4d156ce154f5fb5d516afb278cb15/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:26.283187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.283590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.283940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.337536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] MFA Rules not processed for user `84b4d156ce154f5fb5d516afb278cb15`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:26.340504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:26.456221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 999/2010] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:26.461500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.540363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.542279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:26.545319 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3d8e1-81b1-4d3b-89fd-623025eb9ae8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.552044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.552903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.553388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.554002 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.554831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.557237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.567015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d6e1-640f-4953-899b-326f841cb7bb None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.571929 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.572757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.573137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.573524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] PATH_INFO: `/v3/projects/2422f190756d44e4a821b98023223369` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.600263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2422f190756d44e4a821b98023223369)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.607224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.612350 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1012/2011] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:26 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:26.616662 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.747227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669a27-e710-4d09-88b0-602f8abea2ea admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:26.755450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2422f190756d44e4a821b98023223369', 'request_id': 'req-67a52259-bb28-4a1f-9e47-276677707d1f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:26.770071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2422f190756d44e4a821b98023223369', 'request_id': 'req-67a52259-bb28-4a1f-9e47-276677707d1f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:26.776641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:26.780264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2422f190756d44e4a821b98023223369', 'request_id': 'req-67a52259-bb28-4a1f-9e47-276677707d1f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:26.827036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] The token cache is being invalidate because project 2422f190756d44e4a821b98023223369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:26.828030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:26.830957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:26.835970 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1000/2012] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:26 2022] DELETE /identity/v3/projects/2422f190756d44e4a821b98023223369 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:26.841827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:26.844291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:26.910487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:26.911768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:26.912052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:26.912326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:26.914563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:26.919128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:26.976678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:26.996585 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1013/2013] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:26 2022] POST /identity/v3/users => generated 299 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:27.001529 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.004863 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.017876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a52259-bb28-4a1f-9e47-276677707d1f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.032922 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fe5a-c16e-469a-aa27-443b80f586d2 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.043522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.044272 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.044559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.044873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] PATH_INFO: `/v3/users/63f9d63e8bda46feb40c79db35404995` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.046294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f9d63e8bda46feb40c79db35404995)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.047108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.047878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.049448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.049628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.050290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.055287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.061491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.095326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1014/2014] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:27.096867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.138043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334b1c0-bbb5-4aa1-aa70-aa8d9babe214 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.155380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.156698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.156698 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.156900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] PATH_INFO: `/v3/projects/8cd56de3948845ef9e26996d1a4f29ff/users/44de5f61e21848aab8261603e52aed6b/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.188807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd56de3948845ef9e26996d1a4f29ff, user_id=44de5f61e21848aab8261603e52aed6b, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.191971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.208386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f9d63e8bda46feb40c79db35404995'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.222326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1015/2015] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:27 2022] PUT /identity/v3/projects/8cd56de3948845ef9e26996d1a4f29ff/users/44de5f61e21848aab8261603e52aed6b/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:27.225079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.231501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f9d63e8bda46feb40c79db35404995'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.232192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f9d63e8bda46feb40c79db35404995'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.257832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f9d63e8bda46feb40c79db35404995'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.259071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f9d63e8bda46feb40c79db35404995'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.308821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1001/2016] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:26 2022] DELETE /identity/v3/users/63f9d63e8bda46feb40c79db35404995 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:27.353582 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c28095-89d3-4db6-93c8-2c9f0d3070c4 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.451746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.452822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.452822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.453122 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.453906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.460017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf002e2-32ff-4053-8d86-e42d1cb75900 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.485136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1016/2017] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:27.488621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.490969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.530729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387016-9a78-43fb-8483-105102e91281 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.549211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.550214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.550503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.551444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] PATH_INFO: `/v3/projects/8cd56de3948845ef9e26996d1a4f29ff/users/44de5f61e21848aab8261603e52aed6b/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.554452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd56de3948845ef9e26996d1a4f29ff, user_id=44de5f61e21848aab8261603e52aed6b, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.558215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.592611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1002/2018] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:27 2022] PUT /identity/v3/projects/8cd56de3948845ef9e26996d1a4f29ff/users/44de5f61e21848aab8261603e52aed6b/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:27.594219 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.594639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.594917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.641176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] MFA Rules not processed for user `44de5f61e21848aab8261603e52aed6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:27.642497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.650610 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:27.744514 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1017/2019] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:27.758002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.759761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.771057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:27.773561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.850741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f62f2-aae0-43d0-b6a4-a445e4998cc9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.854559 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.855258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.856012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.856285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.858096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:27.865338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c40f82-ba14-4077-9536-a18bdb45ec64 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:27.870844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:27.871941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.872225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.872499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] PATH_INFO: `/v3/projects/ddb3516004834dd5910837fe21faffa2` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:27.873830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb3516004834dd5910837fe21faffa2)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.877085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.937734 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:27.939395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f50836-c917-40fa-8663-1e65ec9738de service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:27.942306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb3516004834dd5910837fe21faffa2', 'request_id': 'req-64ff960f-6e16-4979-88a2-68c361abbd8b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.950050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb3516004834dd5910837fe21faffa2', 'request_id': 'req-64ff960f-6e16-4979-88a2-68c361abbd8b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.950225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1003/2020] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:27.957771 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb3516004834dd5910837fe21faffa2', 'request_id': 'req-64ff960f-6e16-4979-88a2-68c361abbd8b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.978161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] The token cache is being invalidate because project ddb3516004834dd5910837fe21faffa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:27.978432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.980166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-64ff960f-6e16-4979-88a2-68c361abbd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:27.981767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1018/2021] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:27 2022] DELETE /identity/v3/projects/ddb3516004834dd5910837fe21faffa2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:27.987288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:27.987569 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:27.987988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.018523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:28.019729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.027460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:28.094847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1004/2022] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:28.102483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.103043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.103357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.128198 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:28.129614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.138661 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1019/2023] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:28.142810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.153192 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a469c1-9318-478f-a123-e972e0fb0502 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.160312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.161042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.161335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.161672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.162370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:28.162679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.164286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.180170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1005/2024] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:28.185890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.202329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad144c6-eb88-4dcf-b246-8a406430bca1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.210850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.211736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.212255 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.212657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.213434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.215636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.247632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1020/2025] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:28.251677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.263472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbf43f-4406-46ee-be1a-ec83113bca40 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.334995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.335626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.335910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.336221 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.336825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.338788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.374007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1006/2026] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:28.378242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.388708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:28.399364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100eeee-5e29-4e12-b76d-6acf95eab955 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.405998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.406628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.406908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.408729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.409422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.411271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.426005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1021/2027] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:28.426567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.441342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff481-e716-4fab-a818-60bd2a47037d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.458626 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.459511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.459769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.460113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.461090 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.463034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.481338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1007/2028] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:28.482890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.493976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe6d0-4289-4faa-9361-3daa75af6823 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.502919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.503978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.506937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.507394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] PATH_INFO: `/v3/projects/934c7f86a9d94f6eb4b1dbb28dd32221/users/b9a2917e8a15420e8e08ee2199c23d92/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.524584 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c7f86a9d94f6eb4b1dbb28dd32221, user_id=b9a2917e8a15420e8e08ee2199c23d92, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.529620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.532544 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a057b1-24cc-4c1c-af2e-2c7dd845c7e4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.532701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.561852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648612ef-db5f-4286-9590-f4a7ba744b6c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.564914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1022/2029] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:28 2022] PUT /identity/v3/projects/934c7f86a9d94f6eb4b1dbb28dd32221/users/b9a2917e8a15420e8e08ee2199c23d92/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:28.567024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.567024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.569372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.603809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] MFA Rules not processed for user `b9a2917e8a15420e8e08ee2199c23d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:28.606164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.726081 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1023/2030] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:28.727071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.748408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.749151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.749868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.749868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] PATH_INFO: `/v3/users/47f0fee18e704b8e8de43ff5c5f3bdce` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.751172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f0fee18e704b8e8de43ff5c5f3bdce)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.753562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.797385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:28.860432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f0fee18e704b8e8de43ff5c5f3bdce'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:28.889547 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c13f-8fd3-401d-b1a3-1d07190ead0c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:28.890620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f0fee18e704b8e8de43ff5c5f3bdce'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:28.891281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f0fee18e704b8e8de43ff5c5f3bdce'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:28.895200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:28.895878 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.896106 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.896372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.897015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:28.899212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133594ac-db55-4c83-b663-8a3bb73719b5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:28.910314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f0fee18e704b8e8de43ff5c5f3bdce'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:28.911304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f0fee18e704b8e8de43ff5c5f3bdce'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:28.928434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1008/2031] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:28 2022] DELETE /identity/v3/users/47f0fee18e704b8e8de43ff5c5f3bdce => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:28.929460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:28.930919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.932747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1024/2032] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:28.933938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:28.934412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:28.934595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:28.954098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:28.955307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:28.994986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:29.002023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccded69-4ef7-4467-bd50-c67beb6a3de4 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.017985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1025/2033] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:29.018835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.020164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.032523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1f8f-03ce-422f-a257-d1d3c7b394ce None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.037210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.037804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.038112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.038387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.039033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.040905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.066147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1026/2034] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:29 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:29.066147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.066147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.067294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.067973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.068259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.068525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] PATH_INFO: `/v3/users/2f185b0b11254019934abcb538ef1d2c` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.069889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f185b0b11254019934abcb538ef1d2c)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.071873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.119318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:29.121316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f185b0b11254019934abcb538ef1d2c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.125503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f00e2d-1de8-4382-8acd-64efaa7bc4d2 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.129866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.130497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.130779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.130892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f185b0b11254019934abcb538ef1d2c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.131051 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.131491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f185b0b11254019934abcb538ef1d2c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.140773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.142244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.145084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f185b0b11254019934abcb538ef1d2c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.145793 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-78243913-b916-4a75-aae3-7564f4ba80f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f185b0b11254019934abcb538ef1d2c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.151615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1027/2035] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:29.153107 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.158772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1009/2036] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:28 2022] DELETE /identity/v3/users/2f185b0b11254019934abcb538ef1d2c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:29.162463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b8eb8-50d3-48ff-9de6-a9a8c0883d58 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.163903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.164204 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.165190 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.194447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:29.196150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.237173 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.237800 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.238119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.238390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.239045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.240940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.254467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1028/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:29.258683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.261166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.275125 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1010/2038] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:29.275642 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ef9-ff63-48b7-b0ca-57f6f0b2ac5a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.280908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.281648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.281926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.282259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] PATH_INFO: `/v3/projects/733da1204699444d99666b5ec0ffd183/users/b598f0656a9f4716936076ce50f6de48/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.289532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.291011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.302971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=733da1204699444d99666b5ec0ffd183, user_id=b598f0656a9f4716936076ce50f6de48, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.306791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.327745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1029/2039] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:29 2022] PUT /identity/v3/projects/733da1204699444d99666b5ec0ffd183/users/b598f0656a9f4716936076ce50f6de48/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:29.331782 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.380154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f4e15-58d8-41d9-b1a4-c48eafb03692 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.396213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:29.445651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293cd7f-6de1-4bf4-a8a9-cf27a5e51d1d admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.450131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.450872 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.451164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.451443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.459304 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.459938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.460257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.460478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.461135 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.463025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.479142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.481183 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0520-a7e1-4649-bf16-53aa372c4602 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.481490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1030/2040] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:29.486609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.493374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1011/2041] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:29.497357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762bcf-a6f6-46bd-b05b-74c49dc1579b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.505438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.505438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.505438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.505438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] PATH_INFO: `/v3/projects/733da1204699444d99666b5ec0ffd183/users/b598f0656a9f4716936076ce50f6de48/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.507829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733da1204699444d99666b5ec0ffd183, user_id=b598f0656a9f4716936076ce50f6de48, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.512835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.525077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1031/2042] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:29 2022] PUT /identity/v3/projects/733da1204699444d99666b5ec0ffd183/users/b598f0656a9f4716936076ce50f6de48/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:29.535222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.535538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.535803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.564333 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.566178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.576235 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] MFA Rules not processed for user `b598f0656a9f4716936076ce50f6de48`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:29.577991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.593639 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:29.716944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd514ea7-448b-493f-a315-05aea5679d19 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:29.731881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:29.735590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:29.735931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:29.736218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] PATH_INFO: `/v3/projects/c60b2fe09e2e41009d1fb42eaa0ec5b6` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:29.739560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60b2fe09e2e41009d1fb42eaa0ec5b6)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:29.741541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:29.762888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1012/2043] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:29.771485 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.775262 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.867324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60b2fe09e2e41009d1fb42eaa0ec5b6', 'request_id': 'req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.874652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60b2fe09e2e41009d1fb42eaa0ec5b6', 'request_id': 'req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.882864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60b2fe09e2e41009d1fb42eaa0ec5b6', 'request_id': 'req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.914857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] The token cache is being invalidate because project c60b2fe09e2e41009d1fb42eaa0ec5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:29.915078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.917998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:29.920595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1032/2044] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:29 2022] DELETE /identity/v3/projects/c60b2fe09e2e41009d1fb42eaa0ec5b6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:29.924314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:29.926636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:29.952482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4357d2-967f-4f2d-b04e-5088625feef6 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:30.013531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:30.014318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:30.014737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:30.015276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:30.023399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:30.083110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:30.113329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e20c-1bfc-42ad-891e-8d4126e8fe60 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:30.129580 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:30.130286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:30.130569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:30.130850 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] PATH_INFO: `/v3/users/87b9446e46f64c6cac25ed8bd600f424` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:30.132044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b9446e46f64c6cac25ed8bd600f424)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:30.134215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:30.184533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:30.189200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:30.220832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1013/2045] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:30.227508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:30.231603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:30.251367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ed097-8085-40d2-8534-48e009399562 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:30.262918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:30.263973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:30.264990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:30.265731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] PATH_INFO: `/v3/projects/fae0dfe232124836ad1cecc3c4d5775d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:30.268110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae0dfe232124836ad1cecc3c4d5775d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:30.270660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:30.276523 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b9446e46f64c6cac25ed8bd600f424'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.284430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:30.293471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b9446e46f64c6cac25ed8bd600f424'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.337814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b9446e46f64c6cac25ed8bd600f424'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.339012 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b9446e46f64c6cac25ed8bd600f424'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.339941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b9446e46f64c6cac25ed8bd600f424'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.360201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae0dfe232124836ad1cecc3c4d5775d', 'request_id': 'req-7152b2b7-ac75-4600-b8cf-b622c3e324d2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.363236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1033/2046] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:29 2022] DELETE /identity/v3/users/87b9446e46f64c6cac25ed8bd600f424 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:30.364171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:30.366482 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:30.370585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae0dfe232124836ad1cecc3c4d5775d', 'request_id': 'req-7152b2b7-ac75-4600-b8cf-b622c3e324d2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.382678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae0dfe232124836ad1cecc3c4d5775d', 'request_id': 'req-7152b2b7-ac75-4600-b8cf-b622c3e324d2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.396824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] The token cache is being invalidate because project fae0dfe232124836ad1cecc3c4d5775d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:30.397123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.397784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.399544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1014/2047] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:30 2022] DELETE /identity/v3/projects/fae0dfe232124836ad1cecc3c4d5775d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:30.403583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:30.405395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:30.446704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63041-f862-45ef-8530-221badb98892 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:30.450686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:30.451438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:30.451835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:30.452218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:30.454287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:30.482127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b2b7-ac75-4600-b8cf-b622c3e324d2 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:30.529417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:30.531005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:30.541044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1034/2048] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:30.557194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:30.558077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:30.558535 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:30.559538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] PATH_INFO: `/v3/users/abc9482ffb6a43b3bcb6bff566d52968` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:30.560867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc9482ffb6a43b3bcb6bff566d52968)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:30.564567 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:30.634230 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:30.637587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc9482ffb6a43b3bcb6bff566d52968'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.653130 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc9482ffb6a43b3bcb6bff566d52968'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.653883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc9482ffb6a43b3bcb6bff566d52968'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.674023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc9482ffb6a43b3bcb6bff566d52968'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.674023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc9482ffb6a43b3bcb6bff566d52968'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:30.707348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1015/2049] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:30 2022] DELETE /identity/v3/users/abc9482ffb6a43b3bcb6bff566d52968 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:31.321908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.339006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37425-f519-4778-bce5-76a35f202f0a service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:31.359245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.362760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:31.410335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:31.489795 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:31.490731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.491008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.491279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] PATH_INFO: `/v3/projects/94616f222a374663aa90501cbf89e540` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.493028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] RBAC: Authorizing `identity:delete_project(project_id=94616f222a374663aa90501cbf89e540)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:31.494446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:31.545076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ba8e-46cf-4e1d-be93-030bf03a9b27 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:31.551163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:31.551974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.552429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.552850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] PATH_INFO: `/v3/projects/faaa2493a3284fbda761e4f66e6e9714` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.554338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaa2493a3284fbda761e4f66e6e9714)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:31.556890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:31.621573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94616f222a374663aa90501cbf89e540', 'request_id': 'req-b1e8ba44-f579-4c1f-bc79-8549a58c21af'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.633433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94616f222a374663aa90501cbf89e540', 'request_id': 'req-b1e8ba44-f579-4c1f-bc79-8549a58c21af'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.641646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94616f222a374663aa90501cbf89e540', 'request_id': 'req-b1e8ba44-f579-4c1f-bc79-8549a58c21af'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.653393 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaa2493a3284fbda761e4f66e6e9714', 'request_id': 'req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.658262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] The token cache is being invalidate because project 94616f222a374663aa90501cbf89e540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:31.658628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.659361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b1e8ba44-f579-4c1f-bc79-8549a58c21af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.661115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaa2493a3284fbda761e4f66e6e9714', 'request_id': 'req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.662436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1035/2050] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:31 2022] DELETE /identity/v3/projects/94616f222a374663aa90501cbf89e540 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:31.671100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45df09-387d-45ea-9e7e-753324c245e7 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.672181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45df09-387d-45ea-9e7e-753324c245e7 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.672181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45df09-387d-45ea-9e7e-753324c245e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.703195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaa2493a3284fbda761e4f66e6e9714', 'request_id': 'req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.720864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9b45df09-387d-45ea-9e7e-753324c245e7 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:31.723037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] The token cache is being invalidate because project faaa2493a3284fbda761e4f66e6e9714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:31.723313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9b45df09-387d-45ea-9e7e-753324c245e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:31.725463 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.733844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.737136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1016/2051] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:31 2022] DELETE /identity/v3/projects/faaa2493a3284fbda761e4f66e6e9714 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:31.741557 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.743005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:31.801536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1036/2052] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:31.802820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:31.810189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.810479 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.810828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.818118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5bb6-fa3b-48a0-9b21-11c0c58bafdf admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:31.823396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:31.824729 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.825012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.825286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] PATH_INFO: `/v3/users/bb6ce89a2b254ec89d2108daf2bdbffb` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.826481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6ce89a2b254ec89d2108daf2bdbffb)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:31.828417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:31.831867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:31.833100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:31.842740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1037/2053] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:31.846710 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.856313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798c1a-68c3-4f96-9831-9e3cbbeceb24 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:31.861460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:31.862136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.862419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.862690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.863341 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:31.863651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:31.865484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:31.878269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6ce89a2b254ec89d2108daf2bdbffb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.878489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1038/2054] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:44:31.883035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.887379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6ce89a2b254ec89d2108daf2bdbffb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.888049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6ce89a2b254ec89d2108daf2bdbffb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.893946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671ac75-4acb-487d-a92a-2abd793ce1f0 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:31.900819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:31.900973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6ce89a2b254ec89d2108daf2bdbffb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.901730 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6ce89a2b254ec89d2108daf2bdbffb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:31.902358 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:31.902598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:31.903227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:31.904020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:31.905838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:31.924555 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1017/2055] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:31 2022] DELETE /identity/v3/users/bb6ce89a2b254ec89d2108daf2bdbffb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:31.939938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1039/2056] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:31 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:31.944285 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:31.945770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.017383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ee0d-b4e4-48da-896b-5d37ce6edae6 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.076768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.077868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.078062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.078388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.079051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.081344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.110270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1018/2057] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:31 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:32.111449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.126496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec627c-078b-4baa-9d90-a4e8cf54a25e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.133632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.134621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.135123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.135408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.136066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.138013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.154160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1040/2058] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:32.155510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.171451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24f59-508c-49c5-9432-31d58e4e3bc6 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.180338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.180779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.181248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.181738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.182527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.185060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.187772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:32.198274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1019/2059] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:32.202067 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.209049 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:32.214456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c5fd-6309-4d93-86c6-8f0f60e1711a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.222980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.224243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.224680 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.225077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] PATH_INFO: `/v3/projects/9299321840634be6a664d6c9598c05c0/users/d1e3995571884c39ab5a47812bab6cb4/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.248615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.250424 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.256147 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9299321840634be6a664d6c9598c05c0, user_id=d1e3995571884c39ab5a47812bab6cb4, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.260259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7553b-a4cb-4af8-834c-d06170637205 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.267780 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa004-ee66-465a-98b2-9e0eb2f77fb0 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.272253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.273571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.273571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.273937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] PATH_INFO: `/v3/projects/f8104183da934342b285382f0b710d71` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.275208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8104183da934342b285382f0b710d71)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.278329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.297893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1041/2060] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:32 2022] PUT /identity/v3/projects/9299321840634be6a664d6c9598c05c0/users/d1e3995571884c39ab5a47812bab6cb4/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:32.309461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.309753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.310058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.345444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8104183da934342b285382f0b710d71', 'request_id': 'req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.346628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] MFA Rules not processed for user `d1e3995571884c39ab5a47812bab6cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:32.348655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.353333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8104183da934342b285382f0b710d71', 'request_id': 'req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.364056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8104183da934342b285382f0b710d71', 'request_id': 'req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.375607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] The token cache is being invalidate because project f8104183da934342b285382f0b710d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:32.375906 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.376620 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-f9232cbe-3b8c-45c5-acc7-d32836ab6fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.378376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1020/2061] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:32 2022] DELETE /identity/v3/projects/f8104183da934342b285382f0b710d71 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:32.386928 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc154a-c585-48ec-8a6f-f118f0b5801a None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.387877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc154a-c585-48ec-8a6f-f118f0b5801a None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.389083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc154a-c585-48ec-8a6f-f118f0b5801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.411541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-79cc154a-c585-48ec-8a6f-f118f0b5801a None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:32.413014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-79cc154a-c585-48ec-8a6f-f118f0b5801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.423414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1042/2062] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:32.436377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.440328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.495400 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1021/2063] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:32.505885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.506888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.506888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.510729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150aea-aa4c-41c5-b094-dc14acca4a7e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.516186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.516807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.517088 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.517366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.526715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.527565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:32.528192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.529473 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.537380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1043/2064] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:32.538877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1022/2065] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:32.543717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.557824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4c88-e368-422c-9f7e-6b7ea9c44d47 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.563189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.563918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.564611 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.564903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.565006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.565180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.565857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:32.566177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.568033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.578627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44668-ca87-4c27-ae5e-0b2b26529fa9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.581669 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1044/2066] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:32.584150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.585092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.585231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.585455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] PATH_INFO: `/v3/users/d1e3995571884c39ab5a47812bab6cb4` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.585921 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.586691 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e3995571884c39ab5a47812bab6cb4)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.588739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.596227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97452963-e312-4eb4-8c1d-d06bbd6b6300 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.601387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.602024 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.602310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.602581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.603208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.605124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.656000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1045/2067] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:32.660696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.694801 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e3995571884c39ab5a47812bab6cb4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.706521 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e3995571884c39ab5a47812bab6cb4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.707686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e3995571884c39ab5a47812bab6cb4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.730904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:32.733360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e3995571884c39ab5a47812bab6cb4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.735030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b3840fa3-2e47-46c0-837a-81aa2aaad7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e3995571884c39ab5a47812bab6cb4'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:32.771271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:32.800241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1023/2068] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:32 2022] DELETE /identity/v3/users/d1e3995571884c39ab5a47812bab6cb4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:32.804556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.805560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.805950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.831979 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bb49-7e3c-4fd2-b526-95e67e49d5ce admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:32.846646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:32.849380 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.922492 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:32.923254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:32.923605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:32.923947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:32.924841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:32.926882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:32.932419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1024/2069] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:32.934195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.937309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:32.957057 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1046/2070] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:32 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:32.957913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:32.961303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.018039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c04e33-3855-49d2-96e3-3175cf986ede None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.025326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.026409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.027492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.028431 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.031312 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.043395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46914-b099-4bbc-af9f-e7fcb35ccd80 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.046473 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.047091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.047383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.047672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.059677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.061119 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.071991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1047/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:33.072823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.075259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.092760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00987735-f674-4eed-88cd-57971cb342da service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.098512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.099519 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.099808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.100104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.100917 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.102836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.119100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1048/2072] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:33.123820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.124406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.126670 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.143302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e98e1-df66-42cd-80c0-a6eb4b313ac8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.150932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.151337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1025/2073] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:33.151543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.151826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.152621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.153526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.155501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a29117-b05f-4722-b2c5-ad6e3c149911 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.170555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1049/2074] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:33.174650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.190982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d34a6-bf14-4957-8203-0823374f6810 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.196085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.196967 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.197410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.197693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] PATH_INFO: `/v3/projects/7716a4a6759d42e8ad995648d833d5f0/users/a68f709bf5b84b109ca6659d00e7a71e/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.216244 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7716a4a6759d42e8ad995648d833d5f0, user_id=a68f709bf5b84b109ca6659d00e7a71e, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.219132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.238496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1026/2075] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:33 2022] PUT /identity/v3/projects/7716a4a6759d42e8ad995648d833d5f0/users/a68f709bf5b84b109ca6659d00e7a71e/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:33.250308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.250904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.251190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.284429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] MFA Rules not processed for user `a68f709bf5b84b109ca6659d00e7a71e`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:33.285535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.362786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:33.393551 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1050/2076] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:33.398665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.414603 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:33.424028 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.425632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.499347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0940-d47b-4e34-82fd-99f464de56ff admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.506682 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.507811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.508273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.510492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.512062 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.514954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.531431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90a668-7055-4ad5-9ccc-0eb26c6ab445 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.540393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.541649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.542062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.542347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] PATH_INFO: `/v3/projects/9299321840634be6a664d6c9598c05c0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.544077 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9299321840634be6a664d6c9598c05c0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.546860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.564126 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1027/2077] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:33.568109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.606405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9299321840634be6a664d6c9598c05c0', 'request_id': 'req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:33.612281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9299321840634be6a664d6c9598c05c0', 'request_id': 'req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:33.619956 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9299321840634be6a664d6c9598c05c0', 'request_id': 'req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:33.637069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] The token cache is being invalidate because project 9299321840634be6a664d6c9598c05c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:33.637452 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:33.638432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-565bfdc6-a1c7-41ee-bed6-6ef8beab5a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:33.640454 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1051/2078] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:33 2022] DELETE /identity/v3/projects/9299321840634be6a664d6c9598c05c0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:33.645888 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486726-f17a-436e-8b4c-6c0acb2b0bb9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.646993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.647283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.647615 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.681821 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:33.683745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.746759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.748015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.748397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.748579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.749217 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.751877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f601-9fbd-4095-b3d2-698b7b621478 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.771010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1052/2079] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:33.779824 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1028/2080] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:33.783200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.784112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.784472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.784818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.785208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.806137 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd36c-7e22-4d66-bab5-4cb44d96971e None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.818913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.819767 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.820178 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.820459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.821199 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.822907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.823503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:33.826649 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:33.838171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1053/2081] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:33.841749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.845382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1029/2082] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:33.849572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.853163 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:33.857764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d1855-94f4-4bfd-a3c1-3c528fdb592a admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.867062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.868152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a176e8-f7e0-487c-b1e1-4ff1ee8c65d3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.868432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.869372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.870005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.871632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.873796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.875483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.875918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.876212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.876585 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.877249 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:33.877558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.879186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.894174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1054/2083] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:33.898385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.909483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1030/2084] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:44:33.910579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf541-ca5c-4cee-b5ff-248a06a9e8c0 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.915544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:33.919405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.920218 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.920572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.920919 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] PATH_INFO: `/v3/projects/0ed68a53fc074b00a3bbd35a4b91fe70/users/6e20bbdc75f44b93a416e2bca703c313/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.927715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74a1b-7719-4a35-a0b4-d74854bdae62 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:33.934376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:33.937840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.938159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.938437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.938842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed68a53fc074b00a3bbd35a4b91fe70, user_id=6e20bbdc75f44b93a416e2bca703c313, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.939085 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:33.940988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.941899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad7149-dca9-4140-a6b0-1c5df0fff6e4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:33.960203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1055/2085] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:33 2022] PUT /identity/v3/projects/0ed68a53fc074b00a3bbd35a4b91fe70/users/6e20bbdc75f44b93a416e2bca703c313/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:33.972411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:33.972928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:33.973325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:33.983138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:34.013511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1031/2086] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:34.017330 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.028784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] MFA Rules not processed for user `6e20bbdc75f44b93a416e2bca703c313`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:34.030511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:34.128706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e11-16ea-40aa-b862-c428cc10d027 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.137449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.138170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.138501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.138776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.139887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.141571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.149888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1056/2087] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:34.154062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.193612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1032/2088] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:34 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:34.197950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebeef0-8a34-4aa5-9af3-bd28127c4560 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.199165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.216336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.217344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.217991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.218571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.219403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.224593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.227319 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b72aa-7a57-44a5-bdce-a07d6f7975d0 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.239845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.240545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.240835 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.241189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.241955 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.243739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.256261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1033/2089] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:34.262374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1057/2090] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:34 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:34.266619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.267652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.280114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c54d72-ca01-4c87-bcf4-4e2109d1680a admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.384332 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.384910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.385281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.385572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.386689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.388097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fc10-a70c-41cd-8b2c-80036ef700ba admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.388611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.393258 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.393989 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.394363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.395027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.395557 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.397667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.404120 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1034/2091] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:34.408474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.420191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62053b-6eae-4ce4-9b51-54b12d416e82 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.428877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1058/2092] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:34 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:34.429083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.429083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.429083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.429083 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] PATH_INFO: `/v3/projects/187929dfb6584e3096f03d8c82e9f950/users/cc4eeffdb6a44525a6012700db29148f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.430395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.444010 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187929dfb6584e3096f03d8c82e9f950, user_id=cc4eeffdb6a44525a6012700db29148f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.446791 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bedfd-a200-49e1-ac8c-1f30f6782343 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.449150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed17b5f-aead-487e-9dc7-594e5cb636ad admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.457055 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.458136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.458675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.459232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.461185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.462926 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1035/2093] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:34 2022] PUT /identity/v3/projects/187929dfb6584e3096f03d8c82e9f950/users/cc4eeffdb6a44525a6012700db29148f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:34.464308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.473049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.473545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.473891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.477757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1059/2094] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:34.482932 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.506244 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54e33-fb49-4d2a-bde2-f6eaf562141b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.509505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] MFA Rules not processed for user `cc4eeffdb6a44525a6012700db29148f`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:34.510839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:34.526764 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:34.552479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:34.596570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.597907 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.598463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.598992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] PATH_INFO: `/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa/users/409c48c27dec45d58d044c46999443f9/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.599974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1036/2095] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:34.619464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.624589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:34.628182 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dc29d2143f4d7b9a0950c142ddaaaa, user_id=409c48c27dec45d58d044c46999443f9, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.631643 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.648331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1060/2096] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:34 2022] PUT /identity/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa/users/409c48c27dec45d58d044c46999443f9/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:34.652973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.701702 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc396f-a15e-43a3-9f67-14508bed6278 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.750240 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcdeb2-daad-4aea-9968-1dfa04a86e3b admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.760901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.762717 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.763238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.763727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.764812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.766659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.770318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.770941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.771222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.771493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.786029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1061/2097] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:34.787977 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:34.800169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57450-0593-48fc-b66b-b64416dd1d0e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:34.807769 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:34.809112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.809458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.809732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] PATH_INFO: `/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa/users/409c48c27dec45d58d044c46999443f9/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.811822 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dc29d2143f4d7b9a0950c142ddaaaa, user_id=409c48c27dec45d58d044c46999443f9, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.816832 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b1e1-6985-4cef-a690-648966271f92 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.830920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1062/2098] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:34 2022] PUT /identity/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa/users/409c48c27dec45d58d044c46999443f9/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:34.842616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af289a-8547-4570-a862-e481bb484624 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:34.842918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af289a-8547-4570-a862-e481bb484624 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:34.843245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af289a-8547-4570-a862-e481bb484624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:34.861619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:34.863310 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:34.875063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1037/2099] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:34.883180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b6af289a-8547-4570-a862-e481bb484624 None None] MFA Rules not processed for user `409c48c27dec45d58d044c46999443f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:34.884390 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b6af289a-8547-4570-a862-e481bb484624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:34.971403 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1063/2100] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:35.043279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:35.043279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:35.050862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8427-df5c-4ee5-baa6-808cda50a3f0 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:35.117845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:35.132761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:35.133348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:35.133868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:35.134325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:35.137026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:35.217138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:35.218798 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:35.229949 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1038/2101] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:36.927761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af289a-8547-4570-a862-e481bb484624 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:36.940337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af289a-8547-4570-a862-e481bb484624 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:36.944252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:36.944926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:36.945206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:36.945476 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:36.950276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:37.027421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:37.029043 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:37.038759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1064/2102] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:37.624386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:37.626222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:37.723707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015156-8968-4d0a-8986-1235d162d35f service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:37.729921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:37.730978 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:37.731408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:37.731822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] PATH_INFO: `/v3/users/b9a2917e8a15420e8e08ee2199c23d92` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:37.733707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a2917e8a15420e8e08ee2199c23d92)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:37.736363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:37.781397 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:37.792315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2b42-6f90-4148-a9fb-12ff68035782 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:37.796915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:37.797677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:37.798064 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:37.798370 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:37.802858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a2917e8a15420e8e08ee2199c23d92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:37.813626 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:37.815651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e13d78-1b77-487b-958c-c981a5d9e579 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:37.816314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a2917e8a15420e8e08ee2199c23d92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:37.816900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a2917e8a15420e8e08ee2199c23d92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:37.831005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1065/2103] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:37.837993 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a2917e8a15420e8e08ee2199c23d92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:37.839189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a2917e8a15420e8e08ee2199c23d92'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:37.857441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1039/2104] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:37 2022] DELETE /identity/v3/users/b9a2917e8a15420e8e08ee2199c23d92 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:37.861026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:37.861493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:37.861931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:37.901196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:37.902556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.097896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1066/2105] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:38.110034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.111700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.154726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:38.254604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc034036-c5f9-44eb-9d5f-7c0c15143047 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.259071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.259859 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.260194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.260589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.274466 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.276170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ff182-181b-4844-84e7-e784406e3f83 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.289238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1040/2106] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:38.358185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.359736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.376652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5fea3-34d3-40b5-a9c4-9f7df72d7f60 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.382250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.383003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.383281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.383561 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] PATH_INFO: `/v3/users/84b4d156ce154f5fb5d516afb278cb15` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.384869 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b4d156ce154f5fb5d516afb278cb15)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.387470 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.459351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b4d156ce154f5fb5d516afb278cb15'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.470796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b4d156ce154f5fb5d516afb278cb15'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.485708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b4d156ce154f5fb5d516afb278cb15'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.486555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b4d156ce154f5fb5d516afb278cb15'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.487177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b4d156ce154f5fb5d516afb278cb15'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.503020 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1067/2107] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:38 2022] DELETE /identity/v3/users/84b4d156ce154f5fb5d516afb278cb15 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:38.508060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.508442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.508718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.535964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:38.537684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.632185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1041/2108] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:38.650555 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.652659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.662339 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:38.753242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7bdd-fb74-449f-8695-bd4d16d4644f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.757217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.757934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.758362 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.758709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.772299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.774120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.789543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1068/2109] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:38.837484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.839028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.854907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5f1d-205f-4eeb-9775-317c38d73b33 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.860440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.861091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.861721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.862104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] PATH_INFO: `/v3/projects/934c7f86a9d94f6eb4b1dbb28dd32221` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.863279 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934c7f86a9d94f6eb4b1dbb28dd32221)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.867259 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.955475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934c7f86a9d94f6eb4b1dbb28dd32221', 'request_id': 'req-37af18fe-3987-483d-a70d-96b1c70d26d8'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.970832 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934c7f86a9d94f6eb4b1dbb28dd32221', 'request_id': 'req-37af18fe-3987-483d-a70d-96b1c70d26d8'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.987108 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934c7f86a9d94f6eb4b1dbb28dd32221', 'request_id': 'req-37af18fe-3987-483d-a70d-96b1c70d26d8'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.004282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] The token cache is being invalidate because project 934c7f86a9d94f6eb4b1dbb28dd32221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:39.004282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.004750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.010191 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1042/2110] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:38 2022] DELETE /identity/v3/projects/934c7f86a9d94f6eb4b1dbb28dd32221 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:39.011091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.021999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6dad1-7e69-47bd-b7c9-c1d1e733d4f3 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.124256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.126114 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.126735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.127162 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] PATH_INFO: `/v3/users/b598f0656a9f4716936076ce50f6de48` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.129316 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b598f0656a9f4716936076ce50f6de48)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.137630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.255684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b598f0656a9f4716936076ce50f6de48'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.268143 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b598f0656a9f4716936076ce50f6de48'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.286398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.288016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.290195 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b598f0656a9f4716936076ce50f6de48'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.291111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b598f0656a9f4716936076ce50f6de48'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.291813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b598f0656a9f4716936076ce50f6de48'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.317227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af18fe-3987-483d-a70d-96b1c70d26d8 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.322192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1069/2111] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:39 2022] DELETE /identity/v3/users/b598f0656a9f4716936076ce50f6de48 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:39.430764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:39.499146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.500434 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.501876 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.503292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] PATH_INFO: `/v3/projects/ce25df64dac24429886a003cf84d32c9` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.506539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce25df64dac24429886a003cf84d32c9)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.510687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.600727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce25df64dac24429886a003cf84d32c9', 'request_id': 'req-6dc4d904-9461-4f11-a741-188b8342eb9b'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.611925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce25df64dac24429886a003cf84d32c9', 'request_id': 'req-6dc4d904-9461-4f11-a741-188b8342eb9b'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.638836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce25df64dac24429886a003cf84d32c9', 'request_id': 'req-6dc4d904-9461-4f11-a741-188b8342eb9b'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.675551 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] The token cache is being invalidate because project ce25df64dac24429886a003cf84d32c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:39.676512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.677894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.680907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1043/2112] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:39 2022] DELETE /identity/v3/projects/ce25df64dac24429886a003cf84d32c9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:39.690631 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.692171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.716208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb2446-85ce-40cd-bfff-f548a7ed3c81 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.764236 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:39.821593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.822928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.823499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.824124 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] PATH_INFO: `/v3/users/44de5f61e21848aab8261603e52aed6b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.826773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44de5f61e21848aab8261603e52aed6b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.831128 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.872500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.874005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.886826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d904-9461-4f11-a741-188b8342eb9b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.892375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.893019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.893477 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.893762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] PATH_INFO: `/v3/projects/733da1204699444d99666b5ec0ffd183` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.895443 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733da1204699444d99666b5ec0ffd183)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.897596 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.910876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44de5f61e21848aab8261603e52aed6b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.920353 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44de5f61e21848aab8261603e52aed6b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.934385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44de5f61e21848aab8261603e52aed6b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.935225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44de5f61e21848aab8261603e52aed6b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.935920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-83bc3dea-c71a-44e8-8319-f354078b230e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44de5f61e21848aab8261603e52aed6b'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.948750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1070/2113] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:39 2022] DELETE /identity/v3/users/44de5f61e21848aab8261603e52aed6b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:39.957774 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733da1204699444d99666b5ec0ffd183', 'request_id': 'req-90e8d66f-2cd5-40df-a650-b946f6f66726'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.964243 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733da1204699444d99666b5ec0ffd183', 'request_id': 'req-90e8d66f-2cd5-40df-a650-b946f6f66726'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.973476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733da1204699444d99666b5ec0ffd183', 'request_id': 'req-90e8d66f-2cd5-40df-a650-b946f6f66726'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.985436 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] The token cache is being invalidate because project 733da1204699444d99666b5ec0ffd183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:39.986019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.986841 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-90e8d66f-2cd5-40df-a650-b946f6f66726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.988676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1044/2114] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:39 2022] DELETE /identity/v3/projects/733da1204699444d99666b5ec0ffd183 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:39.994082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c514-7c26-4ed3-ae74-dc8f47e018ea None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.994376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c514-7c26-4ed3-ae74-dc8f47e018ea None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.994651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c514-7c26-4ed3-ae74-dc8f47e018ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.016775 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9367c514-7c26-4ed3-ae74-dc8f47e018ea None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:40.017635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9367c514-7c26-4ed3-ae74-dc8f47e018ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.099065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1071/2115] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:40.108492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.108788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.109067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.123793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48693-c7d7-4286-b3a4-c47f3b107cf5 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.124089 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48693-c7d7-4286-b3a4-c47f3b107cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.124364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48693-c7d7-4286-b3a4-c47f3b107cf5 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.126546 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1072/2116] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:44:40.140616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.142887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.143330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.169575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:40.170942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.174164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:40.177712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.197264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1045/2117] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:40.206481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.219762 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a08d1-8316-40f0-878e-f3735222706e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.225300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.226046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.226630 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.226980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.228331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:40.228708 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.236017 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.245158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:40.262700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1046/2118] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:40.263749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.265677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.279475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1073/2119] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:40.280323 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.282079 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32340-1cb5-4fc7-9ab3-2e1ca3231009 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.292861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f3d2f-95bc-4c77-aba7-3d493882be44 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.293885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.294853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.295117 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.295583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] PATH_INFO: `/v3/users/fa7605034d1f4b74b56d11a0af8cd77f` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.297113 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7605034d1f4b74b56d11a0af8cd77f)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.298563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.299217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.299629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.302259 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.302569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.303268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.305196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.334687 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1074/2120] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:40.338404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.338404 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.353767 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:40.373468 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7605034d1f4b74b56d11a0af8cd77f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.381209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7605034d1f4b74b56d11a0af8cd77f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.381845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7605034d1f4b74b56d11a0af8cd77f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.394889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7605034d1f4b74b56d11a0af8cd77f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.395584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7605034d1f4b74b56d11a0af8cd77f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.409077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1047/2121] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:40 2022] DELETE /identity/v3/users/fa7605034d1f4b74b56d11a0af8cd77f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:40.409902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.411255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.413330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc68f-180b-49de-81a9-990fc4025be3 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.484440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b120c-23ce-450f-8b3a-dc7f60326b15 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.490437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.491496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.491784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.492060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] PATH_INFO: `/v3/projects/8cd56de3948845ef9e26996d1a4f29ff` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.493887 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd56de3948845ef9e26996d1a4f29ff)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.496430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.501283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142c9bc9ea44b61919dbb527904ef55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.501904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.502214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.502489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.505579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.519365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.520950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.551974 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1075/2122] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:40.553713 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.554000 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd56de3948845ef9e26996d1a4f29ff', 'request_id': 'req-25e6648a-8348-4425-aa5b-09f2540a43b7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.558987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.579015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9012b-5c62-4927-8ba7-63d167e8a4c4 service placement] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.586706 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd56de3948845ef9e26996d1a4f29ff', 'request_id': 'req-25e6648a-8348-4425-aa5b-09f2540a43b7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.608397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd56de3948845ef9e26996d1a4f29ff', 'request_id': 'req-25e6648a-8348-4425-aa5b-09f2540a43b7'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.641915 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] The token cache is being invalidate because project 8cd56de3948845ef9e26996d1a4f29ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:40.642579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.643313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.646376 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1048/2123] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:40 2022] DELETE /identity/v3/projects/8cd56de3948845ef9e26996d1a4f29ff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:40.647328 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.649011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.676295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:40.707707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.707707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.707707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.707707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.708008 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.711139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65626dc9-25d4-499f-8bba-0ad0f1f566d8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.711457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:40.744834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6648a-8348-4425-aa5b-09f2540a43b7 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.756861 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1076/2124] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:40.761951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.762495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.762777 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.766672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:40.767458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.767631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.768073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] PATH_INFO: `/v3/projects/1c03790e5d44455aaa9b5c3646b9275c` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.769461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c03790e5d44455aaa9b5c3646b9275c)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:40.773680 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:40.794826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:40.802283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.837447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1077/2125] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:40.837447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:40.838881 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:40.866018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c03790e5d44455aaa9b5c3646b9275c', 'request_id': 'req-012617a6-f3da-488d-ac39-4abd1dc4f144'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.869402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f973f6-4987-4cae-a9d0-32a361a170ea None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:40.878602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c03790e5d44455aaa9b5c3646b9275c', 'request_id': 'req-012617a6-f3da-488d-ac39-4abd1dc4f144'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.891857 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c03790e5d44455aaa9b5c3646b9275c', 'request_id': 'req-012617a6-f3da-488d-ac39-4abd1dc4f144'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.920399 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] The token cache is being invalidate because project 1c03790e5d44455aaa9b5c3646b9275c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:40.920974 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.922058 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-012617a6-f3da-488d-ac39-4abd1dc4f144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:40.924042 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1049/2126] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:40 2022] DELETE /identity/v3/projects/1c03790e5d44455aaa9b5c3646b9275c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:40.926523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c37a1-7ec7-44d3-b59f-32537aacc181 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:40.926955 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c37a1-7ec7-44d3-b59f-32537aacc181 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:40.927437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c37a1-7ec7-44d3-b59f-32537aacc181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:40.954248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d79c37a1-7ec7-44d3-b59f-32537aacc181 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:40.955489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d79c37a1-7ec7-44d3-b59f-32537aacc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.000684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.001636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.001636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.002556 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.002673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.004412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672298d0-bf33-430e-a3bb-9741494ec19c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.022232 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1078/2127] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.023902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.026064 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.027887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.066289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:41.068768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.085359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1079/2128] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.087225 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.088590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.101034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1050/2129] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.102558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2ce4-e0cc-4abe-acd8-3161248e33d5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.103048 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.103345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.103704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.109948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.111417 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.111868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.112363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.113264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.115537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.127652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:41.128672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1080/2130] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.129176 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.130302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.139142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1051/2131] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.143007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13732-7792-4685-abc6-00d2f349c3ed admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.143716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.148474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.149289 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.149723 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.150357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.151174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:41.151628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.154375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.169335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867acef0-0a56-40d6-9f00-6a5e79f15f7e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.176172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1081/2132] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:41.177041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.179532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.180391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.180724 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.181013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] PATH_INFO: `/v3/projects/748410e3204340c39efb2e9990831136/users/fafff745846543689e4f839050213f28/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.192915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a01b1-585e-4804-bb2f-3f6bd3f672f3 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.200772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.201433 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.201718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.202100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.202750 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:41.203050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.203636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748410e3204340c39efb2e9990831136, user_id=fafff745846543689e4f839050213f28, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.204938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.206674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.217826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1082/2133] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:41.218606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.226037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1052/2134] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:41 2022] PUT /identity/v3/projects/748410e3204340c39efb2e9990831136/users/fafff745846543689e4f839050213f28/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:41.226037 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.230773 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ee63-348a-452e-bab7-a222df6fc4db admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.272568 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:41.299667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.300334 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.300500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bc209-a551-48a5-af28-fffc43df0e58 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.300675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.300887 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.301597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.303612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4153c91-a219-4eb9-be1e-6724c70c6157 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.306684 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.307586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.307874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.308336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.308988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.310952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.337313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1083/2135] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.337313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.337313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.337313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.343997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1053/2136] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.343997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.363213 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:41.366761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] MFA Rules not processed for user `fafff745846543689e4f839050213f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:41.369272 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.405450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63d4f8-eee5-4abe-8535-924213de3d0f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.410462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.411106 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.411391 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.411667 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.412302 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.414273 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.441631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1054/2137] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.443012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.447420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1084/2138] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.449038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.457055 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661544-3b2e-4b89-9f61-3e13a3be02b0 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.462167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.462646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791f36-b725-4ace-84dd-74b0c4c5fc53 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.462816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.463095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.463396 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.463928 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.466385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.468951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.469704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.470211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.470657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.471480 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.473201 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.484895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1085/2139] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.484895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.491788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1055/2140] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/users => generated 302 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.492726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.499111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fef37-d104-476e-ae51-83c4506e5fa5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.503870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a7c4-941c-4c73-a38e-debb148a936a admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.504183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.504838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.505118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.505420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.506074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.508047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.508676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.509398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.509686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.510047 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.510696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.512840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.529428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1056/2141] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.529428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.537429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a940-e10b-42c8-8a99-325a8b8266d5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.538247 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1086/2142] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.539050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.601865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.602508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.603121 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.603233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82a8a-a625-448f-bfd1-a578ab459fd1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.603529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.604188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.607030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.608743 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.609477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.609766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.610109 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] PATH_INFO: `/v3/projects/a165ed466a104fa587a1266b3272410b/users/530e1fe800a44cdabe0c8f02b8058951/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.618331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1057/2143] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.619136 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.628401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a165ed466a104fa587a1266b3272410b, user_id=530e1fe800a44cdabe0c8f02b8058951, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.630679 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9291a4-946f-4b76-9c6e-9cdb870b82b4 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.631174 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.636073 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.637268 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.637783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.637900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.638575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.640516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccd239-9c5a-4dfa-9a3d-4c4adc55d8fb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.646138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1087/2144] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:41 2022] PUT /identity/v3/projects/a165ed466a104fa587a1266b3272410b/users/530e1fe800a44cdabe0c8f02b8058951/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:41.647134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.672584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1058/2145] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/users => generated 298 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:41.674039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.674337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.674619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.682578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:41.706407 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:41.709629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] MFA Rules not processed for user `530e1fe800a44cdabe0c8f02b8058951`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:41.711022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.718609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3cfb5-9db5-4e02-bb7f-a3a6333d7c51 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.724281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.724835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.725150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.725422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.726100 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.727704 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.738716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1088/2146] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.740313 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.751569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3dd9-b8cc-4240-9e40-eeabba483ea8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.756160 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.756752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.757034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.757302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.757935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.759520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.770496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1089/2147] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.771788 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.782372 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd4dfe-4970-4aaf-ac22-9e0faef7922f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.787988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1059/2148] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.788471 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.788828 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.789506 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.789797 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.790115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] PATH_INFO: `/v3/projects/f1db29191046494288fe7ced71800687/users/3a307105a4bf4cd8bb36604ae371ba0a/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.802491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fc843-3ca4-48b8-aa21-16d3d0f50b1f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.806663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1db29191046494288fe7ced71800687, user_id=3a307105a4bf4cd8bb36604ae371ba0a, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.807741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.808435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.808720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.809002 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] PATH_INFO: `/v3/projects/85bf7ff8faf54657a5641401eedcdf58/users/41856e6af97843ad8b76bfb5acc946d1/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.809552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.823431 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1090/2149] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:41 2022] PUT /identity/v3/projects/f1db29191046494288fe7ced71800687/users/3a307105a4bf4cd8bb36604ae371ba0a/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:41.824942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.827127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf7ff8faf54657a5641401eedcdf58, user_id=41856e6af97843ad8b76bfb5acc946d1, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.828905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.830142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05b15e-6187-4ac2-9967-64c161702dd2 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.844954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1060/2150] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:41 2022] PUT /identity/v3/projects/85bf7ff8faf54657a5641401eedcdf58/users/41856e6af97843ad8b76bfb5acc946d1/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:41.846387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.846763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.847027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.866374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:41.867577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:41.893990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ccc5-f696-4f36-9704-c61d615f68c8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.933068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1061/2151] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:41.933946 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.947336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcbe11-e93c-4694-ba6c-e7dc14164666 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:41.951263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.952047 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.952324 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.952592 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.953206 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:41.953810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:41.954137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:41.954415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:41.955099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:41.956874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:41.968209 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1062/2152] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:41.969141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:41.971406 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:42.012840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.014542 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.024899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1091/2153] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:42.026184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:42.041256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c514-6f14-4d92-b1bb-059755010e1c service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:42.042219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d03526-ff1f-467f-849c-d0dd760a46cd admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:42.046435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:42.046581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:42.047139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.047338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.047712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.048081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.048267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.048560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] PATH_INFO: `/v3/projects/85bf7ff8faf54657a5641401eedcdf58/users/41856e6af97843ad8b76bfb5acc946d1/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.051570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf7ff8faf54657a5641401eedcdf58, user_id=41856e6af97843ad8b76bfb5acc946d1, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.054745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff380-dd81-4624-9f8c-b04f81820da5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.060664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.062387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.069590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1092/2154] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:42 2022] PUT /identity/v3/projects/85bf7ff8faf54657a5641401eedcdf58/users/41856e6af97843ad8b76bfb5acc946d1/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:42.081314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1063/2155] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:42.082010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.082377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.082725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.106205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:42.115849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] MFA Rules not processed for user `41856e6af97843ad8b76bfb5acc946d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:42.117158 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:42.229995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1093/2156] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:42.254874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:42.256482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:42.264385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:42.271610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5730e-27e2-43a7-964f-cd1a0c05f3c9 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:42.350987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:42.352019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.352737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.353152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.381345 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.383266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.408652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1064/2157] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:42.607568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:42.609336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:42.615701 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:42.627138 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160622-45d5-431c-8c22-fb881e9152e6 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:42.637553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:42.638233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.638655 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.639907 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.704831 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43a2be-cc76-4892-a9d7-219f866431c1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:42.710472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:42.711618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.712053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.712412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] PATH_INFO: `/v3/users/a68f709bf5b84b109ca6659d00e7a71e` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.712721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.713852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68f709bf5b84b109ca6659d00e7a71e)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:42.714564 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d83e7d-76ff-4054-a574-131ca3c03d9e service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.716245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:42.734383 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1065/2158] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:42.809909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68f709bf5b84b109ca6659d00e7a71e'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:42.822031 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68f709bf5b84b109ca6659d00e7a71e'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:42.837746 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68f709bf5b84b109ca6659d00e7a71e'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:42.838651 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68f709bf5b84b109ca6659d00e7a71e'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:42.840146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-e03a82d0-e3b8-4ad7-8375-b53da1348535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68f709bf5b84b109ca6659d00e7a71e'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:42.857786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1094/2159] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:42 2022] DELETE /identity/v3/users/a68f709bf5b84b109ca6659d00e7a71e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:42.862283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.862575 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.862855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.889759 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:42.891186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:42.986769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1066/2160] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:42.987003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:42.987003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:42.987003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:42.995271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:42.997604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.027130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] MFA Rules not processed for user `3a307105a4bf4cd8bb36604ae371ba0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:43.030791 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.036525 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:43.069775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:43.099267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb6b5-fe01-4041-a7be-255ee1c57b0e None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.106462 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.107350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.107705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.108082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.122252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.123805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.136868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1067/2161] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:43.138920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.141095 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1095/2162] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:43.142143 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.145581 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.147060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.161790 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ecdd-2ac5-4027-914e-c485120cb776 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.163925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244565c0-eb86-4b5f-a43e-7ff1df62f095 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.168810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.170185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.171181 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.171522 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.171927 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.172329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.172602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.172992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] PATH_INFO: `/v3/users/fafff745846543689e4f839050213f28` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.174231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.174882 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafff745846543689e4f839050213f28)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.177161 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.179508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.235140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1096/2163] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:43 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:43.237901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafff745846543689e4f839050213f28'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.239359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.250265 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafff745846543689e4f839050213f28'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.252024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafff745846543689e4f839050213f28'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.268309 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafff745846543689e4f839050213f28'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.269092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-05ded679-d7b5-4df1-bce0-7df5e34cf716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafff745846543689e4f839050213f28'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.286124 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1068/2164] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:43 2022] DELETE /identity/v3/users/fafff745846543689e4f839050213f28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:43.290808 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.291096 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.291369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.315103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:43.316325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.337808 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca13af-c0a8-4162-89a6-bdd3da6de185 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.423588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.424494 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.424910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.426004 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.426148 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.428183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.433129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1069/2165] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:43.445660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.447475 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.459508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1097/2166] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:43 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:43.463524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.465667 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.477716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066abe-a9c4-4f90-a19b-387ce54499c5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.486876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.487559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.488716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.488716 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.489271 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.491188 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.503204 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1098/2167] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:43.507475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.517702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e515a1-4169-44f6-bf94-eeced4125012 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.523400 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.524142 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.524435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.524789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] PATH_INFO: `/v3/projects/935d4b197cae490aa47874f8d688834d/users/8883be1b97e4406e92d9432c96dd9dc1/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.528576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff696cd1-65a9-4ba3-8f42-6111b101e344 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.539045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:43.549338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.551177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.551177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.551177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.567829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.570720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.580483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935d4b197cae490aa47874f8d688834d, user_id=8883be1b97e4406e92d9432c96dd9dc1, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.584274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.602413 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1099/2169] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:43 2022] PUT /identity/v3/projects/935d4b197cae490aa47874f8d688834d/users/8883be1b97e4406e92d9432c96dd9dc1/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:43.602606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1070/2169] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:43.603009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.605706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:43.607072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.613945 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:43.624433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aed05-2d88-4e02-bf77-e514aa41188a service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.694318 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f355-13ea-4fcb-a51e-6db0a2867528 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.701794 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.702587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.703009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.703383 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] PATH_INFO: `/v3/projects/7716a4a6759d42e8ad995648d833d5f0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.714356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.715030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.715316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.715586 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.716238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.717852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.718330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7716a4a6759d42e8ad995648d833d5f0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.722096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.731156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1071/2170] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:43.735365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.748232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b415b76-6704-4b99-9d69-a0e7da1c6522 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:43.766198 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:43.767208 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:43.767502 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:43.767833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] PATH_INFO: `/v3/projects/935d4b197cae490aa47874f8d688834d/users/8883be1b97e4406e92d9432c96dd9dc1/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:43.770207 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=935d4b197cae490aa47874f8d688834d, user_id=8883be1b97e4406e92d9432c96dd9dc1, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:43.773344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:43.786651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1072/2171] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:43 2022] PUT /identity/v3/projects/935d4b197cae490aa47874f8d688834d/users/8883be1b97e4406e92d9432c96dd9dc1/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:43.823217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7716a4a6759d42e8ad995648d833d5f0', 'request_id': 'req-6fd4ebfe-514e-4621-8170-21f832153961'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.833484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7716a4a6759d42e8ad995648d833d5f0', 'request_id': 'req-6fd4ebfe-514e-4621-8170-21f832153961'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.845736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7716a4a6759d42e8ad995648d833d5f0', 'request_id': 'req-6fd4ebfe-514e-4621-8170-21f832153961'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.867540 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] The token cache is being invalidate because project 7716a4a6759d42e8ad995648d833d5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:43.867913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.868701 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:43.877243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1100/2172] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:43 2022] DELETE /identity/v3/projects/7716a4a6759d42e8ad995648d833d5f0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:43.879445 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:43.881788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:44.007420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.009069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:44.057455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e66a38-30b3-4b87-9e85-e8f77793d1fc admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.152042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4ebfe-514e-4621-8170-21f832153961 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.157027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.157666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.157942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.158242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] PATH_INFO: `/v3/projects/748410e3204340c39efb2e9990831136` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.160554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748410e3204340c39efb2e9990831136)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.165325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.166722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.169129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.170006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.170006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] PATH_INFO: `/v3/users/6e20bbdc75f44b93a416e2bca703c313` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.171728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e20bbdc75f44b93a416e2bca703c313)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.175337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.207026 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:44.256401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748410e3204340c39efb2e9990831136', 'request_id': 'req-88df6403-db0e-49a2-a047-ae310f0ae905'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.266490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748410e3204340c39efb2e9990831136', 'request_id': 'req-88df6403-db0e-49a2-a047-ae310f0ae905'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.271989 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:44.274991 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748410e3204340c39efb2e9990831136', 'request_id': 'req-88df6403-db0e-49a2-a047-ae310f0ae905'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.300842 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e20bbdc75f44b93a416e2bca703c313'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.311909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e20bbdc75f44b93a416e2bca703c313'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.312954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e20bbdc75f44b93a416e2bca703c313'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.319038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] The token cache is being invalidate because project 748410e3204340c39efb2e9990831136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:44.319354 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.320162 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.323896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1101/2173] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:44 2022] DELETE /identity/v3/projects/748410e3204340c39efb2e9990831136 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:44.328622 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.333205 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:44.334172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e20bbdc75f44b93a416e2bca703c313'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.335299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e20bbdc75f44b93a416e2bca703c313'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.369648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1073/2174] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:43 2022] DELETE /identity/v3/users/6e20bbdc75f44b93a416e2bca703c313 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:44.502735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df6403-db0e-49a2-a047-ae310f0ae905 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.682609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.683329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.683707 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.683867 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] PATH_INFO: `/v3/users/41856e6af97843ad8b76bfb5acc946d1` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.685085 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41856e6af97843ad8b76bfb5acc946d1)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.687152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.780123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41856e6af97843ad8b76bfb5acc946d1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.797995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41856e6af97843ad8b76bfb5acc946d1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.800415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:44.837301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41856e6af97843ad8b76bfb5acc946d1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.838176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41856e6af97843ad8b76bfb5acc946d1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.838928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-ae505c86-f3ae-4aff-a066-7b2093c5188c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41856e6af97843ad8b76bfb5acc946d1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:44.858346 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1102/2175] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:44 2022] DELETE /identity/v3/users/41856e6af97843ad8b76bfb5acc946d1 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:44.905126 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.907375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:44.923144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c091531-df29-41c4-9ab1-b8b3d39b0c60 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.000282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.000569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.000841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.031587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] MFA Rules not processed for user `8883be1b97e4406e92d9432c96dd9dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:45.032513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.032721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.034885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.035698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.035698 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] PATH_INFO: `/v3/projects/0ed68a53fc074b00a3bbd35a4b91fe70` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.037478 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed68a53fc074b00a3bbd35a4b91fe70)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.043621 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.141820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1103/2176] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:45.143745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed68a53fc074b00a3bbd35a4b91fe70', 'request_id': 'req-0f05cd7a-d2a1-403a-a56d-f150630d0706'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.154432 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed68a53fc074b00a3bbd35a4b91fe70', 'request_id': 'req-0f05cd7a-d2a1-403a-a56d-f150630d0706'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.166757 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed68a53fc074b00a3bbd35a4b91fe70', 'request_id': 'req-0f05cd7a-d2a1-403a-a56d-f150630d0706'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.186491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] The token cache is being invalidate because project 0ed68a53fc074b00a3bbd35a4b91fe70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:45.187080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.188027 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.190683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1074/2177] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:44 2022] DELETE /identity/v3/projects/0ed68a53fc074b00a3bbd35a4b91fe70 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:45.195902 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.198237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.219748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632374-7ae6-4144-ab03-3939a255f02f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.266986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.269070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.333109 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:45.349940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.350666 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.350895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.351176 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] PATH_INFO: `/v3/users/409c48c27dec45d58d044c46999443f9` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.353000 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409c48c27dec45d58d044c46999443f9)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.355045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.375343 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cd7a-d2a1-403a-a56d-f150630d0706 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.381116 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.381903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.382153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.383388 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] PATH_INFO: `/v3/projects/85bf7ff8faf54657a5641401eedcdf58` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.384227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bf7ff8faf54657a5641401eedcdf58)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.386716 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.416280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409c48c27dec45d58d044c46999443f9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.426683 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409c48c27dec45d58d044c46999443f9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.434183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:45.448449 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bf7ff8faf54657a5641401eedcdf58', 'request_id': 'req-e271a7be-dc0e-4518-a610-ca18e510355c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.450478 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409c48c27dec45d58d044c46999443f9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.451736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409c48c27dec45d58d044c46999443f9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.452848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-c54a75a3-f58b-4d36-8a34-93fd72386808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409c48c27dec45d58d044c46999443f9'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.456370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bf7ff8faf54657a5641401eedcdf58', 'request_id': 'req-e271a7be-dc0e-4518-a610-ca18e510355c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.481251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1104/2178] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:45 2022] DELETE /identity/v3/users/409c48c27dec45d58d044c46999443f9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:45.484581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bf7ff8faf54657a5641401eedcdf58', 'request_id': 'req-e271a7be-dc0e-4518-a610-ca18e510355c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.502818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] The token cache is being invalidate because project 85bf7ff8faf54657a5641401eedcdf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:45.504282 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.505170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-e271a7be-dc0e-4518-a610-ca18e510355c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:45.507177 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1075/2179] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:45 2022] DELETE /identity/v3/projects/85bf7ff8faf54657a5641401eedcdf58 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:45.512309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.512804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.513428 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.537513 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:45.539118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.624048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1105/2180] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:45.633604 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.633930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.634839 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.658333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:45.658333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.666335 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1076/2181] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:45.671423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.692301 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde25f3-fbce-4e7b-adcc-671795296da1 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.697579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.698217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.698496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.698796 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.699442 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:45.699768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.701328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.713392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1106/2182] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:45.717782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.727920 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3c8b1-c46c-4069-9fff-b6ccfec0f486 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.733422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.734060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.734365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.734636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.735278 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.737200 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.765523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1077/2183] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:45 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:45.769896 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.780908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa9cb-11e3-4278-bbc9-bbc9da45436c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.846901 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.847742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.848129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.848472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.849256 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.851336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.881168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1107/2184] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:45 2022] POST /identity/v3/users => generated 280 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:45.882843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.906304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec5d6-92d7-4ac1-bf84-b2813478d83e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.912223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.912894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.913629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.915294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.915420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.915531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.916463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:45.916889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.929813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb96c9-8608-42dc-a100-0d4490e12621 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.930448 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1078/2185] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:45.935382 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.940552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.941314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.941461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.941737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] PATH_INFO: `/v3/users/530e1fe800a44cdabe0c8f02b8058951` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.943007 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=530e1fe800a44cdabe0c8f02b8058951)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.945230 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.952524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca313f-c720-4217-9c7c-d61f15906ac9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.959370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.960137 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.960519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.960891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.961731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.963543 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f55ce-8f06-4388-9196-491c7ccc457e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.979610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1079/2186] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:45.979610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330d6b-0731-44e2-a192-455543c82c98 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.979610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330d6b-0731-44e2-a192-455543c82c98 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.979610 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330d6b-0731-44e2-a192-455543c82c98 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.981230 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1080/2187] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:44:45.982034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330d6b-0731-44e2-a192-455543c82c98 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.998864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330d6b-0731-44e2-a192-455543c82c98 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.015327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.015327 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.015648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.015939 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] PATH_INFO: `/v3/projects/1ed1bc49defc478db5c770db3720daa8/users/b4d9ab7d156646df8a32dc4587d72cd3/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.035998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530e1fe800a44cdabe0c8f02b8058951'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.039013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:46.046294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed1bc49defc478db5c770db3720daa8, user_id=b4d9ab7d156646df8a32dc4587d72cd3, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.049255 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c7db-5c89-4830-a79f-e45fc7d89d29 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.062115 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530e1fe800a44cdabe0c8f02b8058951'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.072430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1081/2188] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:45 2022] PUT /identity/v3/projects/1ed1bc49defc478db5c770db3720daa8/users/b4d9ab7d156646df8a32dc4587d72cd3/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:46.074274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc87cc3-58ff-49ce-999a-d86b8e82c7ac None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.074732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc87cc3-58ff-49ce-999a-d86b8e82c7ac None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.075152 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc87cc3-58ff-49ce-999a-d86b8e82c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.075583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530e1fe800a44cdabe0c8f02b8058951'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.082941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530e1fe800a44cdabe0c8f02b8058951'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.083835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-69d5a086-1d01-4907-bb1b-126058b14a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530e1fe800a44cdabe0c8f02b8058951'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.099345 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1108/2189] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:45 2022] DELETE /identity/v3/users/530e1fe800a44cdabe0c8f02b8058951 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:46.100700 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.101052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.101401 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.107901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-2fc87cc3-58ff-49ce-999a-d86b8e82c7ac None None] MFA Rules not processed for user `5142c9bc9ea44b61919dbb527904ef55`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.109286 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2fc87cc3-58ff-49ce-999a-d86b8e82c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.171337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] MFA Rules not processed for user `b4d9ab7d156646df8a32dc4587d72cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.172848 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.218410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:46.241943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1082/2190] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:46.243280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.243625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.244151 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.265981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1109/2191] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:46.266911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.268405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.298862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.298862 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.348965 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74176-6c4d-429f-b73e-b2c9e69c77fb None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.355852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.356491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.356675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.356934 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] PATH_INFO: `/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.358123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9dc29d2143f4d7b9a0950c142ddaaaa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.360035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.376765 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1083/2192] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:46.377914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.379247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.395336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f87a0-bb73-4892-876f-0827ef19d552 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.403429 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142c9bc9ea44b61919dbb527904ef55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.404178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.404560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.404902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.414095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.415781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.427094 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1084/2193] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:46.427656 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9dc29d2143f4d7b9a0950c142ddaaaa', 'request_id': 'req-76e3155d-8544-441b-8982-d0affd2942e8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.427903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.429215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.435758 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:INSERT=1,keystone:DELETE=9,keystone:SELECT=90 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:46.440027 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9dc29d2143f4d7b9a0950c142ddaaaa', 'request_id': 'req-76e3155d-8544-441b-8982-d0affd2942e8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.455493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9dc29d2143f4d7b9a0950c142ddaaaa', 'request_id': 'req-76e3155d-8544-441b-8982-d0affd2942e8'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.474807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] The token cache is being invalidate because project c9dc29d2143f4d7b9a0950c142ddaaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:46.475101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.475781 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.477495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1110/2194] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:46 2022] DELETE /identity/v3/projects/c9dc29d2143f4d7b9a0950c142ddaaaa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:46.478749 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.482766 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.509886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b089de-7893-482c-9b00-a3260deac8fc service placement] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.552477 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3155d-8544-441b-8982-d0affd2942e8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.556159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.556774 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.557052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.557321 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.559214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.566050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.566651 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.566935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.567237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.569625 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.625460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:46.635134 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.636635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33980a05-1f5e-4ae2-a8fd-c00480455771 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.639402 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.640987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.647820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1111/2195] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:46.649673 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56ea68-195c-4608-8a47-991a54fe337f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.650702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56ea68-195c-4608-8a47-991a54fe337f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.650905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1085/2196] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:46.654331 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56ea68-195c-4608-8a47-991a54fe337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.670325 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.678182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.687326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6a56ea68-195c-4608-8a47-991a54fe337f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.688564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6a56ea68-195c-4608-8a47-991a54fe337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.696605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb40fc-de78-4ece-ab89-842ac65dd9e5 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.703657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1112/2197] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:46.706156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.706156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.706156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.706156 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] PATH_INFO: `/v3/users/b4d9ab7d156646df8a32dc4587d72cd3` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.710982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d9ab7d156646df8a32dc4587d72cd3)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.712152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.712718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.713022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.713228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.742152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.743906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.752630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1113/2198] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:46.756990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.768663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87751a-ea64-49b5-b5ae-8b6f0fa6b098 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.773640 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.774391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.774721 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.774942 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.775596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:46.776285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.778129 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.782989 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d9ab7d156646df8a32dc4587d72cd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.796740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1114/2199] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:44:46.800820 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.802025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d9ab7d156646df8a32dc4587d72cd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.802826 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d9ab7d156646df8a32dc4587d72cd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.813202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e2b3-17c3-41f1-96d6-5d373e663578 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.819761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:46.820734 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.821192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.821649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.822560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:46.824992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ba36d-a9eb-4974-8682-49e90268e3d4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:46.825288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d9ab7d156646df8a32dc4587d72cd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.826169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d9ab7d156646df8a32dc4587d72cd3'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:46.845171 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1086/2200] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:46 2022] DELETE /identity/v3/users/b4d9ab7d156646df8a32dc4587d72cd3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:46.848301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.849619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.867838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1115/2201] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:46.867838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14128-91ad-4351-8602-fe211574b185 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:46.867838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14128-91ad-4351-8602-fe211574b185 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:46.867838 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14128-91ad-4351-8602-fe211574b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:46.889857 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-03d14128-91ad-4351-8602-fe211574b185 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:46.891396 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-03d14128-91ad-4351-8602-fe211574b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.940219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f9b49-9bce-4f41-b0b4-99cc8757d5a2 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:46.955098 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:46.978132 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1116/2202] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:46.979356 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14128-91ad-4351-8602-fe211574b185 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:46.981210 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-03d14128-91ad-4351-8602-fe211574b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:46.996724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14128-91ad-4351-8602-fe211574b185 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.002554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.003709 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.004169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.004449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.005091 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.006005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.006646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.006924 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.007040 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.007211 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] PATH_INFO: `/v3/users/3a307105a4bf4cd8bb36604ae371ba0a` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.008321 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a307105a4bf4cd8bb36604ae371ba0a)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.010242 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.024820 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.035654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1117/2203] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:46 2022] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:47.036786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.041639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.075500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a307105a4bf4cd8bb36604ae371ba0a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.087545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a307105a4bf4cd8bb36604ae371ba0a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.088458 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a307105a4bf4cd8bb36604ae371ba0a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.108013 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a307105a4bf4cd8bb36604ae371ba0a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.108127 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddd970-f6f5-4ef5-9b01-c13de92622df admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.108665 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a307105a4bf4cd8bb36604ae371ba0a'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.112009 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.112805 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.113252 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.113663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.117374 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.129615 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1087/2204] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:46 2022] DELETE /identity/v3/users/3a307105a4bf4cd8bb36604ae371ba0a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:47.130927 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.133902 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.134414 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.135834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.149141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1118/2205] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:47.150025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.152601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.167164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7abcf-d409-4ca7-8fd2-3e308b358a24 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.241912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.242604 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.242888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.243162 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] PATH_INFO: `/v3/projects/a165ed466a104fa587a1266b3272410b` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.244340 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a165ed466a104fa587a1266b3272410b)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.246908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.253878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa2098-4708-4570-b385-154a3ca88e62 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.260510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.262387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.262817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.263168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.263951 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.266057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.283510 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1088/2206] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:47.289579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.304886 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ff35-995b-45d8-99ec-3e6407d3d9a3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.311953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a165ed466a104fa587a1266b3272410b', 'request_id': 'req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.321694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a165ed466a104fa587a1266b3272410b', 'request_id': 'req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.331851 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a165ed466a104fa587a1266b3272410b', 'request_id': 'req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.359684 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] The token cache is being invalidate because project a165ed466a104fa587a1266b3272410b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:47.360212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.361456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-3870ac37-d065-4ef2-ad3f-dccea0ad3f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.364449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1119/2207] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:47 2022] DELETE /identity/v3/projects/a165ed466a104fa587a1266b3272410b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:47.372343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824d1-1fac-463e-be91-aba10aacde62 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.376409 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824d1-1fac-463e-be91-aba10aacde62 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.377006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824d1-1fac-463e-be91-aba10aacde62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.391977 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.392745 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.393093 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.393456 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.394231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.395963 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.400094 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.410132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1089/2208] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:47.414725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.419283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.427621 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-254824d1-1fac-463e-be91-aba10aacde62 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:47.429727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-254824d1-1fac-463e-be91-aba10aacde62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.435659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2a5d4-8d51-4c71-96d6-2ecfc7078073 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.442280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.443220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.443653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.444193 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] PATH_INFO: `/v3/projects/0dcd5208e7b04abab9759410468d353c/users/5130026be93d4bd085b2bb0fc886f68f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.449835 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1120/2209] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:47.459146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.459435 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.459686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.483023 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:47.485829 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcd5208e7b04abab9759410468d353c, user_id=5130026be93d4bd085b2bb0fc886f68f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.486193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.489802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444178-3db7-4c96-abb2-709f1f8c7c49 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.497931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1121/2210] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:47.499086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.503634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.509371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcb79a-0d35-48c2-b1f7-4d1631581db5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.512264 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1090/2211] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:47 2022] PUT /identity/v3/projects/0dcd5208e7b04abab9759410468d353c/users/5130026be93d4bd085b2bb0fc886f68f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:47.523678 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.524091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.524433 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.561373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] MFA Rules not processed for user `5130026be93d4bd085b2bb0fc886f68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:47.563544 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.586013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.586645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.586929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.587203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.587864 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:47.588169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.590338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.602489 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1122/2212] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:47.608120 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.619449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2cafb-8900-4754-be8b-ddcfb28db4af admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.625200 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a605-25db-4736-8123-110becce14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.626111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a605-25db-4736-8123-110becce14fb admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.626365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a605-25db-4736-8123-110becce14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.626648 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a605-25db-4736-8123-110becce14fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.627693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898a605-25db-4736-8123-110becce14fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.630598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898a605-25db-4736-8123-110becce14fb admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.654224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1091/2213] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:47.666984 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.668388 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1123/2214] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:47 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:47.669664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.672263 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a605-25db-4736-8123-110becce14fb admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.785995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d409e-d7ba-4fa9-8a55-6ecf164839d5 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.798046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a605-25db-4736-8123-110becce14fb admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.805093 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.806022 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.806732 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.806854 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.807823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.812080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.838830 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1124/2215] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:47 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:47.840065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.841995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.852966 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.853595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.853880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.854186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.856727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93de3a-c480-411d-826b-3aaa34328ce0 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.861929 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.862607 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.862890 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.863164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] PATH_INFO: `/v3/projects/f1db29191046494288fe7ced71800687` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.864336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1db29191046494288fe7ced71800687)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.866559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.915628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.919371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1db29191046494288fe7ced71800687', 'request_id': 'req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.922836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.924635 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.925630 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1db29191046494288fe7ced71800687', 'request_id': 'req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.929772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.933620 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1db29191046494288fe7ced71800687', 'request_id': 'req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.935761 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1092/2216] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:47.936877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.938350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.948943 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] The token cache is being invalidate because project f1db29191046494288fe7ced71800687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:47.949239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.950079 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.954935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1125/2217] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:47 2022] DELETE /identity/v3/projects/f1db29191046494288fe7ced71800687 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:47.954935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.956025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef33e-02ac-4d74-b23b-727681f4e729 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.956459 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.024253 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.025043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.025336 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.025611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] PATH_INFO: `/v3/projects/1ed1bc49defc478db5c770db3720daa8` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.027329 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed1bc49defc478db5c770db3720daa8)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.029231 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.052882 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b64d-f601-4f23-b14b-d3eb5f298f1c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.058793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.059439 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.059840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.059983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.060663 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.062357 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.078076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1126/2218] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:48.082972 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.085005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.088619 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed1bc49defc478db5c770db3720daa8', 'request_id': 'req-fff51429-9cba-481b-90b7-334faf89bb9c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.096605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed1bc49defc478db5c770db3720daa8', 'request_id': 'req-fff51429-9cba-481b-90b7-334faf89bb9c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.099629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe76ff-84ca-45a7-9fae-642c35ff3f3f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.105333 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed1bc49defc478db5c770db3720daa8', 'request_id': 'req-fff51429-9cba-481b-90b7-334faf89bb9c'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.117594 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] The token cache is being invalidate because project 1ed1bc49defc478db5c770db3720daa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:48.118022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.119149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.126480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1093/2219] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:47 2022] DELETE /identity/v3/projects/1ed1bc49defc478db5c770db3720daa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:48.126480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.126480 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.162839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.163920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.164437 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.164931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] PATH_INFO: `/v3/users/8883be1b97e4406e92d9432c96dd9dc1` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.166306 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8883be1b97e4406e92d9432c96dd9dc1)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.170385 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.210205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff51429-9cba-481b-90b7-334faf89bb9c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.216908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.217595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.217988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.219174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.219697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.221741 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ce0e7-838a-4b0d-84c8-d709454b3edd admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.228944 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8883be1b97e4406e92d9432c96dd9dc1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.238066 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8883be1b97e4406e92d9432c96dd9dc1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.242647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1094/2220] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:48.242647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445d14-d7e0-4c01-afae-031bc59413c8 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.242647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445d14-d7e0-4c01-afae-031bc59413c8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.242647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445d14-d7e0-4c01-afae-031bc59413c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.256951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8883be1b97e4406e92d9432c96dd9dc1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.257804 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8883be1b97e4406e92d9432c96dd9dc1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.259668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8883be1b97e4406e92d9432c96dd9dc1'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.263915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:48.272827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-1c445d14-d7e0-4c01-afae-031bc59413c8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:48.274245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-1c445d14-d7e0-4c01-afae-031bc59413c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.288974 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1127/2221] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:48 2022] DELETE /identity/v3/users/8883be1b97e4406e92d9432c96dd9dc1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:48.292216 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.293311 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.297597 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1095/2222] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:48.305674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.306241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.306688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.354087 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:48.359092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.383588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:48.475095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1096/2223] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:48.476111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.484824 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca97b9-2410-4dd9-b019-b3411a78b978 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.488039 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377598-935c-47fd-832a-2147f6dd3273 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.493641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.494542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.494900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.496194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.496940 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:48.497318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.499317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.500146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.501010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.501641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.502118 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] PATH_INFO: `/v3/projects/f6283272d428430aaea3458f96d39283/users/b43d08ccaf7f41a8825e20b3ada92ef5/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.529435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1097/2224] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:48.535770 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.545156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6283272d428430aaea3458f96d39283, user_id=b43d08ccaf7f41a8825e20b3ada92ef5, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.548996 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc005-0e8b-405f-96cf-a16195837485 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.561571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e67839-21d6-43c8-8f6c-88660d1b8356 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.577995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1128/2225] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:48 2022] PUT /identity/v3/projects/f6283272d428430aaea3458f96d39283/users/b43d08ccaf7f41a8825e20b3ada92ef5/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:48.582947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.584296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.584883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.587663 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.588489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.590277 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.590671 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.591080 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.592385 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.639220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:48.640955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.663250 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1098/2226] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:48.664481 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.770214 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1129/2227] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:48.770359 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc35336-aaae-47be-9b0b-6fbf1be5bef5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.775349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.775980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.776266 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.776547 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.777245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.779247 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.782908 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.784702 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.811160 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1099/2228] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:48.813063 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.829919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedfe2e-bc8c-4b0f-b670-cf22836b38cb admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.842553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.844212 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.845011 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.845490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.846153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.847950 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.865628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1100/2229] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:48.867935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.879229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daac90-73cd-4771-8f1c-dbb100843eb4 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.882525 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607a4c-8eec-43c7-8e27-5d4d96673109 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.893420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.894147 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.894447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.894891 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.895410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.897289 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.914069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1101/2230] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:48.914069 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.914354 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.928443 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:48.929026 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b112fb-a281-494e-b737-da1c0db52ac3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.935056 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.935755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.936046 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.936326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] PATH_INFO: `/v3/projects/935d4b197cae490aa47874f8d688834d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.937629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935d4b197cae490aa47874f8d688834d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.939755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.962090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.962898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.963180 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.963451 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.974976 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.976737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.989441 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1130/2231] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:48.990913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.001475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab70ac-9328-4893-959c-f60033facce7 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.011996 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:49.016293 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935d4b197cae490aa47874f8d688834d', 'request_id': 'req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.028723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935d4b197cae490aa47874f8d688834d', 'request_id': 'req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.040165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935d4b197cae490aa47874f8d688834d', 'request_id': 'req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.061464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] The token cache is being invalidate because project 935d4b197cae490aa47874f8d688834d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:49.061982 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.063363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-2d5deaa2-5b2d-4944-973c-ca57ab4edd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.065023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1102/2232] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:48 2022] DELETE /identity/v3/projects/935d4b197cae490aa47874f8d688834d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:49.069733 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52ad1-fea8-4bea-95f0-58d6ba1b8392 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.070220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52ad1-fea8-4bea-95f0-58d6ba1b8392 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.070602 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52ad1-fea8-4bea-95f0-58d6ba1b8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.102013 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.102730 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.103090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.103650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] PATH_INFO: `/v3/projects/77be27a0491e45828b8e66311388d41c/users/01ac0557c4b24e9f9b8c96f9cd249f5f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.103778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-4bb52ad1-fea8-4bea-95f0-58d6ba1b8392 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.105172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4bb52ad1-fea8-4bea-95f0-58d6ba1b8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.118020 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1103/2233] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:49.124963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77be27a0491e45828b8e66311388d41c, user_id=01ac0557c4b24e9f9b8c96f9cd249f5f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.125529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.125833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.126153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.127852 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6960-10fc-435d-b380-1c4c9092f188 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.143706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1131/2234] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:48 2022] PUT /identity/v3/projects/77be27a0491e45828b8e66311388d41c/users/01ac0557c4b24e9f9b8c96f9cd249f5f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:49.151228 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.152488 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.155070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.155330 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.155571 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.187261 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] MFA Rules not processed for user `01ac0557c4b24e9f9b8c96f9cd249f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.188650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.227196 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1104/2235] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:49.233742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.246627 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b74b8f-f02c-4ee0-af35-50267fab9c98 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.252709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.253232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.253513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.253831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.254633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:49.254973 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.256566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.269271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1105/2236] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:49.274348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.278995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1132/2237] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:49.290435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6e32-9a81-4cf1-ad51-24a563da6d34 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.292117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.294809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.295919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.296827 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.297103 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.297514 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.298340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.300428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.349304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1106/2238] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:49.350418 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.390815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:49.407570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30e44a-feb2-42ae-94b2-8bd7d94ebc88 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.455222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84315-349e-4ea2-8306-fa17d1af5b78 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.461792 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.462687 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.463375 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.463840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.464686 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.467149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.486657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.488059 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.489866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.492913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.529001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1107/2239] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:49.537038 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.549947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74ff-406f-45e9-a3d5-b05e7b20859e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.559528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.560082 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.560386 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.560657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.561291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.563021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.576081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1108/2240] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:49.580344 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.586380 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.588900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.592666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59789-90b4-4bc8-a9b1-9d25a5a1fcd9 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.599347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.599347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.600486 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.601051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.601877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.602595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1133/2241] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:49.603503 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85938aff-86b7-494d-b0ed-e49bbdf9fa24 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.611180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:49.624489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1109/2242] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:49.629148 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.649221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8aba2-259a-423c-9b20-a4ef903345f9 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.654925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.655605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.655888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.656164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] PATH_INFO: `/v3/projects/9ed433a578a04400b9c25570dd401c05/users/cec8bcfeff484a058e71fc414a3fc985/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.692963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed433a578a04400b9c25570dd401c05, user_id=cec8bcfeff484a058e71fc414a3fc985, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.696914 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dadafa-b6e7-427b-8aa0-d29f36263e4b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.721410 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1134/2243] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:49 2022] PUT /identity/v3/projects/9ed433a578a04400b9c25570dd401c05/users/cec8bcfeff484a058e71fc414a3fc985/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:49.735472 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.736903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.737420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.798437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] MFA Rules not processed for user `cec8bcfeff484a058e71fc414a3fc985`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.801281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.818171 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.818646 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.818941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.905360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] MFA Rules not processed for user `b43d08ccaf7f41a8825e20b3ada92ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.908233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.960005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1110/2244] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:49.966536 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.084879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1135/2245] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:50.147195 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6519-3dba-4997-8e01-2fab17fddad9 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.154092 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.155067 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.155608 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.155977 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.156810 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.159280 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.176496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.208082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:50.214490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1111/2246] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:50.219129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.294112 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d4b3-f58b-42fb-aed3-4505eb162bfe None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.337622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057147b-9557-445e-896d-35f4e817c38d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.343600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.344241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.344524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.344796 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.345426 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.347371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.353897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.354668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.355579 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.355920 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.369587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1112/2247] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:50 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:50.373648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.380252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:50.384076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48ded-ac65-4345-a381-49978f941ec3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.390416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.391015 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.391369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.391700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.392357 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.394070 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.404819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1113/2248] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:50.409071 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.414806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.416815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.419362 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824ea4-0c64-47b7-91b1-78067719f7d4 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.424304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.424998 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.425261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.425537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] PATH_INFO: `/v3/projects/16cde3aed50045b2ba378fda276dbe42/users/c14d2da8bb4e4867bed0a1b12899481a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.427141 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1136/2249] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:50.440746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cde3aed50045b2ba378fda276dbe42, user_id=c14d2da8bb4e4867bed0a1b12899481a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.443441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.456460 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1114/2250] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:50 2022] PUT /identity/v3/projects/16cde3aed50045b2ba378fda276dbe42/users/c14d2da8bb4e4867bed0a1b12899481a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:50.460601 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.472090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bffba-2d8e-4a94-a8c2-0f9b4795fece service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.532117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.532807 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.532998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.533276 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.534074 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.535536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5381f-ac39-460e-999f-cdc13d2e11bc admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.547169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1137/2251] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:50.551246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.562004 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819ab1-5349-45ca-92f6-9ae14214ddfb admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.570025 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.570715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.571001 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.571284 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] PATH_INFO: `/v3/projects/16cde3aed50045b2ba378fda276dbe42/users/c14d2da8bb4e4867bed0a1b12899481a/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.573338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cde3aed50045b2ba378fda276dbe42, user_id=c14d2da8bb4e4867bed0a1b12899481a, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.576340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.588712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1115/2252] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:50 2022] PUT /identity/v3/projects/16cde3aed50045b2ba378fda276dbe42/users/c14d2da8bb4e4867bed0a1b12899481a/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:50.600541 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7575-366e-4b83-bd1d-6804af8c185a None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.600836 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7575-366e-4b83-bd1d-6804af8c185a None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.601117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7575-366e-4b83-bd1d-6804af8c185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.633618 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-accc7575-366e-4b83-bd1d-6804af8c185a None None] MFA Rules not processed for user `c14d2da8bb4e4867bed0a1b12899481a`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:50.634906 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-accc7575-366e-4b83-bd1d-6804af8c185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:50.663598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:50.729402 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1138/2253] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:50.741674 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.812409 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d78b-624d-4bf1-bc20-45c2847dfe2b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.816099 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.816704 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.816985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.817300 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.876606 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.878076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.887384 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1116/2254] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:51.822636 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:51.823151 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:51.823273 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:51.843355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] MFA Rules not processed for user `b43d08ccaf7f41a8825e20b3ada92ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:51.844839 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:51.899068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1139/2255] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:53.603844 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:53.606118 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:53.617878 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1dbe2-2b73-4e3b-8b76-b1b4413eb527 service cinder] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:53.621598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:53.622233 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:53.622517 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:53.622793 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:53.634006 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:53.635427 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:53.637726 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:53.639370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdb71-4ab3-4525-95b5-4a755dbfdf3b service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:53.663110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1117/2256] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:53.787257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da850c46-2342-40ce-98d1-bec26cc5526c None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:53.813739 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:53.815302 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:53.815589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:53.815868 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] PATH_INFO: `/v3/users/5130026be93d4bd085b2bb0fc886f68f` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:53.818948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5130026be93d4bd085b2bb0fc886f68f)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:53.823130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:53.943287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5130026be93d4bd085b2bb0fc886f68f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:53.959674 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5130026be93d4bd085b2bb0fc886f68f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:53.970491 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:53.992658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5130026be93d4bd085b2bb0fc886f68f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:53.993589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5130026be93d4bd085b2bb0fc886f68f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:53.994349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5130026be93d4bd085b2bb0fc886f68f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.025484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1140/2257] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:53 2022] DELETE /identity/v3/users/5130026be93d4bd085b2bb0fc886f68f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:54.030194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.030470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.030746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.059313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:54.060930 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:54.146174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:54.162023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1118/2258] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:54.172962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:54.175912 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:54.259394 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f457a-69a5-4754-b2c9-5523457c0e48 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:54.263659 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:54.264281 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.264569 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.264842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.277464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:54.279130 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cecbb-b7dc-49d8-8154-30cbad774c79 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:54.290221 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1141/2259] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:54.612560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:54.614178 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:54.627441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c95931-fa33-438b-923f-dbc5e1fba9c3 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:54.634089 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:54.634863 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.635215 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.635566 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] PATH_INFO: `/v3/projects/0dcd5208e7b04abab9759410468d353c` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.637303 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcd5208e7b04abab9759410468d353c)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:54.639541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:54.696484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcd5208e7b04abab9759410468d353c', 'request_id': 'req-6b06a531-8b4c-4490-aa52-b0297f04f92f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.703728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcd5208e7b04abab9759410468d353c', 'request_id': 'req-6b06a531-8b4c-4490-aa52-b0297f04f92f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.711664 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcd5208e7b04abab9759410468d353c', 'request_id': 'req-6b06a531-8b4c-4490-aa52-b0297f04f92f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.722969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] The token cache is being invalidate because project 0dcd5208e7b04abab9759410468d353c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:54.723248 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.723884 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-6b06a531-8b4c-4490-aa52-b0297f04f92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:54.725372 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1119/2260] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:54 2022] DELETE /identity/v3/projects/0dcd5208e7b04abab9759410468d353c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:54.731108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.731591 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.731785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.752054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:54.753266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:54.818156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1142/2261] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:54.826512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.826846 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.827127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.848497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:54.849772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:54.858261 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1120/2262] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:54.862279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:54.873226 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658970-927c-42aa-a43b-3386ccddbfdd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:54.879284 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:54.880283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.880647 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.880993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.881724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:54.882138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:54.883812 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:54.907453 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1143/2263] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:54.912225 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:54.923189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fc9d3-a10d-4b54-9145-c51e943487bd None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:54.928526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:54.929142 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:54.929865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:54.929865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:54.930355 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:54.932415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:54.971969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1121/2264] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:54 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:54.976923 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:54.995146 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bddf-1fa0-444c-bdc6-007e9e09a3a5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:55.061894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:55.062565 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.063179 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.063461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.064269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:55.066597 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:55.081474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:55.097815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1144/2265] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:54 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:55.099021 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:55.109913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844581d-7dfb-4d66-9809-1f375e509715 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:55.114614 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:55.116739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.116739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.116739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.116739 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:55.118276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:55.134283 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:55.134825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1122/2266] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:55.156036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a45f6-cef4-44ef-b64c-087097856e4c admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:55.161706 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:55.162355 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.162635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.162909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.163570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:55.165224 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f5610-6081-41ce-bdd3-1af26535613e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:55.184454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:55.191715 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1145/2267] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:55.196430 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287fee-7b8a-482b-b5fe-7a5307d32974 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:55.203227 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:55.204623 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.205104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.205528 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] PATH_INFO: `/v3/projects/2073d1cd843f474cac3f6727c01768d6/users/375f60710e5e4cffb6f186ac3d49ac4b/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.222491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2073d1cd843f474cac3f6727c01768d6, user_id=375f60710e5e4cffb6f186ac3d49ac4b, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:55.225356 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:55.252371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1123/2268] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:55 2022] PUT /identity/v3/projects/2073d1cd843f474cac3f6727c01768d6/users/375f60710e5e4cffb6f186ac3d49ac4b/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:55.258053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.258343 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.258625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.290696 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:55.292104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:55.397877 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1146/2269] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:55.412076 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:55.414003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:55.513711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfc678-1269-4d6b-aebf-50e039f49213 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:55.519390 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:55.520245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.520612 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.520969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.537885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:55.539732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608222df-7d0d-48db-8194-c60e3c302737 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:55.555721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1124/2270] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:00.834269 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:00.837257 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:00.857034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e782f-bf1b-4ae9-9ac1-1af6e691fdda None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:00.863589 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:00.865246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:00.865553 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:00.866367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] PATH_INFO: `/v3/users/01ac0557c4b24e9f9b8c96f9cd249f5f` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:00.867429 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ac0557c4b24e9f9b8c96f9cd249f5f)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:00.870034 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:00.889747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:00.890326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:00.890541 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:00.958529 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] MFA Rules not processed for user `375f60710e5e4cffb6f186ac3d49ac4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:00.965784 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:00.995629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:01.001986 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ac0557c4b24e9f9b8c96f9cd249f5f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:01.022658 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ac0557c4b24e9f9b8c96f9cd249f5f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:01.093344 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ac0557c4b24e9f9b8c96f9cd249f5f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:01.094186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ac0557c4b24e9f9b8c96f9cd249f5f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:01.094813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1125/2271] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:01.094947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a090ce87-973a-4ae7-aba2-9f79f2088e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ac0557c4b24e9f9b8c96f9cd249f5f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:01.099024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.113185 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1147/2272] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:00 2022] DELETE /identity/v3/users/01ac0557c4b24e9f9b8c96f9cd249f5f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:01.113419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30441-76e3-4590-950a-91818e13d6dc None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.117384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.117384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.117384 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.151139 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:01.153315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:01.197410 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.198975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.199260 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.199533 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.200180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.202381 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.227050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:01.253950 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1148/2273] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:01.261693 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.263250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:01.271981 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1126/2274] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:01 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:45:01.273040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.275181 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:01.358326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e933-3bc7-426e-b142-ec191b0a0244 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.366520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdaff4-06e8-49d3-8e3a-2e9f116eab0e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.373519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.374505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.375476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.375923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.377005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.379788 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.411223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1127/2275] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:01 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:45:01.412795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.421308 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.422039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.422329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.422606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.427453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36981546-d575-4180-aa7f-f279504940a5 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.433039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.433214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.433806 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.434141 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.434419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.434520 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.435077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.436709 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.446268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1149/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:01.450598 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1128/2277] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:01.458521 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.473772 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b24da-bb69-40e8-8239-1c1ee3bedc7a service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.482962 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.483649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.483933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.484361 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] PATH_INFO: `/v3/projects/c6d565e79d5441389ff89194d35c683b/users/905655d1fd274d4da95c27c814d0b104/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.512140 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d565e79d5441389ff89194d35c683b, user_id=905655d1fd274d4da95c27c814d0b104, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.515097 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.533668 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1150/2278] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:01 2022] PUT /identity/v3/projects/c6d565e79d5441389ff89194d35c683b/users/905655d1fd274d4da95c27c814d0b104/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:01.537744 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.552873 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac607a-1940-414d-b380-f59daf46c1dd admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.566340 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:01.688723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.689368 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.689660 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.689992 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.691091 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.692482 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.712294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1129/2279] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:01.713499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.724988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced5017-2a80-4e78-be80-c365de96fd8f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:01.730056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:01.730657 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:01.730937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:01.731215 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] PATH_INFO: `/v3/projects/c6d565e79d5441389ff89194d35c683b/users/905655d1fd274d4da95c27c814d0b104/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:01.733203 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d565e79d5441389ff89194d35c683b, user_id=905655d1fd274d4da95c27c814d0b104, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:01.736238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3e2f-fd77-45ff-a5d1-4bb6e1d831e1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:01.771503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1151/2280] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:01 2022] PUT /identity/v3/projects/c6d565e79d5441389ff89194d35c683b/users/905655d1fd274d4da95c27c814d0b104/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:01.908636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:01.911484 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:01.928633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd4d5-1725-4550-a3a8-83ed2445911f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:02.052129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:02.052648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:02.052972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:02.053263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] PATH_INFO: `/v3/projects/77be27a0491e45828b8e66311388d41c` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:02.054538 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77be27a0491e45828b8e66311388d41c)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:02.056552 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:02.175613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77be27a0491e45828b8e66311388d41c', 'request_id': 'req-4b4e00fd-701e-43ae-813c-b7181ca2861f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:02.197595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77be27a0491e45828b8e66311388d41c', 'request_id': 'req-4b4e00fd-701e-43ae-813c-b7181ca2861f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:02.228634 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77be27a0491e45828b8e66311388d41c', 'request_id': 'req-4b4e00fd-701e-43ae-813c-b7181ca2861f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:02.250252 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] The token cache is being invalidate because project 77be27a0491e45828b8e66311388d41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:02.250457 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:02.252578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:02.273995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1130/2281] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:01 2022] DELETE /identity/v3/projects/77be27a0491e45828b8e66311388d41c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:08.207303 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.207898 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.208025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.241472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] MFA Rules not processed for user `905655d1fd274d4da95c27c814d0b104`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:08.242849 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.280711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:08.282270 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.335228 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1152/2282] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:08.342295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:08.343742 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.348495 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:08.349715 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:08.381012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e00fd-701e-43ae-813c-b7181ca2861f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:08.385879 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:08.386574 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.386852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.387128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] PATH_INFO: `/v3/users/cec8bcfeff484a058e71fc414a3fc985` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.388298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec8bcfeff484a058e71fc414a3fc985)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:08.390331 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:08.439973 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebea2f-2156-43c8-8a12-e36d8cc4f8f6 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:08.445434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a994eec4a44b782d847b132c6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:08.448915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.448915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.448915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.450424 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.455624 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec8bcfeff484a058e71fc414a3fc985'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:08.469036 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec8bcfeff484a058e71fc414a3fc985'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:08.470003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec8bcfeff484a058e71fc414a3fc985'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:08.494153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec8bcfeff484a058e71fc414a3fc985'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:08.495155 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b04a80cd-213a-474b-860b-4f3c8f70a766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec8bcfeff484a058e71fc414a3fc985'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:08.513831 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1131/2283] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:08 2022] DELETE /identity/v3/users/cec8bcfeff484a058e71fc414a3fc985 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:45:08.515346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1dbe-1d24-4300-8c72-35e898897ccc None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.515640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1dbe-1d24-4300-8c72-35e898897ccc None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.515921 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1dbe-1d24-4300-8c72-35e898897ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.540395 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-290f1dbe-1d24-4300-8c72-35e898897ccc None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:08.542740 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-290f1dbe-1d24-4300-8c72-35e898897ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.551728 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:08.553600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:08.567689 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1153/2284] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:45:08.647520 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1132/2285] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:08.659714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:08.661298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.787359 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb5aa7-3e1c-431f-af9d-889593d35e1b service glance] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:08.847631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.847918 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.848205 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.867708 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:08.869490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:08.870038 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:08.870496 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:08.875172 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:08.876556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:08.883925 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:08.887070 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:08.892465 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:08.911844 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1154/2286] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:08.953843 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1133/2287] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:09.020056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:09.021829 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:09.163865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33fa0-440e-4f71-817e-74f601da9f11 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:09.170595 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:09.171235 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:09.172150 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:09.172432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:09.186250 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:09.188472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:09.201847 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1155/2288] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 15:45:09.341747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:09.343880 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:09.356072 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:09.369629 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072341-8af0-46c2-b4b8-a844c5edde6f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:09.397864 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:09.398562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:09.398845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:09.399123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] PATH_INFO: `/v3/projects/9ed433a578a04400b9c25570dd401c05` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:09.400314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed433a578a04400b9c25570dd401c05)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:09.402476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:09.477738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed433a578a04400b9c25570dd401c05', 'request_id': 'req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.486032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed433a578a04400b9c25570dd401c05', 'request_id': 'req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.498287 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed433a578a04400b9c25570dd401c05', 'request_id': 'req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.513653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] The token cache is being invalidate because project 9ed433a578a04400b9c25570dd401c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:09.514127 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.514959 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.517019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1134/2289] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:09 2022] DELETE /identity/v3/projects/9ed433a578a04400b9c25570dd401c05 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:09.521365 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:09.540138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad95059-7dcb-4ef9-8ddb-f6356bdfe7a8 service swift] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:09.635874 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:09.636672 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:09.636998 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:09.637371 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] PATH_INFO: `/v3/users/c14d2da8bb4e4867bed0a1b12899481a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:09.641238 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14d2da8bb4e4867bed0a1b12899481a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:09.643653 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:09.778309 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14d2da8bb4e4867bed0a1b12899481a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.791474 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14d2da8bb4e4867bed0a1b12899481a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.813036 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14d2da8bb4e4867bed0a1b12899481a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.813786 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14d2da8bb4e4867bed0a1b12899481a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.814415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-a3571288-ab43-4e3e-8e6f-bab3e72ce582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14d2da8bb4e4867bed0a1b12899481a'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:09.830023 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1156/2290] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:09 2022] DELETE /identity/v3/users/c14d2da8bb4e4867bed0a1b12899481a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:10.409080 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:10.414772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:10.436749 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9ea5-f7dd-477d-b1e7-0a8f1aa05c62 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:10.586363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:10.587301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:10.587420 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:10.587727 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] PATH_INFO: `/v3/projects/16cde3aed50045b2ba378fda276dbe42` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:10.590815 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cde3aed50045b2ba378fda276dbe42)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:10.594852 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:10.786865 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cde3aed50045b2ba378fda276dbe42', 'request_id': 'req-0dcdcaf9-84fe-4a81-9b06-c799758373ea'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:10.803044 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cde3aed50045b2ba378fda276dbe42', 'request_id': 'req-0dcdcaf9-84fe-4a81-9b06-c799758373ea'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:10.818246 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cde3aed50045b2ba378fda276dbe42', 'request_id': 'req-0dcdcaf9-84fe-4a81-9b06-c799758373ea'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:10.848237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] The token cache is being invalidate because project 16cde3aed50045b2ba378fda276dbe42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:10.848540 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:10.849219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-0dcdcaf9-84fe-4a81-9b06-c799758373ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:10.852648 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1135/2291] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:10 2022] DELETE /identity/v3/projects/16cde3aed50045b2ba378fda276dbe42 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:10.857860 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:10.858423 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:10.858510 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:10.891992 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:10.942035 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:10.950326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:11.034161 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1157/2292] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:11.040937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.041417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.041703 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.082509 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:11.084170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:11.106834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.107342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1136/2293] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:11.124412 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6f86-aba7-4018-920a-d36a3071eada None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.132329 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.133328 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.133910 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.134426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.135299 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:45:11.135967 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.138183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.152111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1158/2294] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:45:11.157326 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.172387 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22c57-3e27-4397-a588-fe1b7313ed26 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.182059 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.184023 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.184269 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.184699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.185511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.188033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.201505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:11.242268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.261728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1137/2295] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:11.267988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537777ed-40e9-43f3-9089-3ab6b6272244 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.404053 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.404747 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.406310 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.406639 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.407254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.415686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.474286 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1159/2296] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:11.478422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.491377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc735a5-1ee7-4ae4-9376-2f449d1e83cc admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.498936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.499931 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.500890 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.501415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.502534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.510223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.567186 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1138/2297] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:11.568503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.580472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c70e-7aff-4c4e-a507-d44ef850936d admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.586042 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.586911 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.587367 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.587789 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.588625 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.590432 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6383-f242-4bc3-a1ec-3cfd8cfc498c admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.607140 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.617208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1160/2298] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:11.625398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14294b6-c459-4d42-aacb-bceaa380c14f admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.645367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.646185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.647628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.647937 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] PATH_INFO: `/v3/projects/304ffc2b090f4931b3a8931a9260b78a/users/5f969e4f1fa14be186b3b188e2f38fe2/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.706562 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=304ffc2b090f4931b3a8931a9260b78a, user_id=5f969e4f1fa14be186b3b188e2f38fe2, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.709532 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.748470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1139/2299] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:11 2022] PUT /identity/v3/projects/304ffc2b090f4931b3a8931a9260b78a/users/5f969e4f1fa14be186b3b188e2f38fe2/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:45:11.754875 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.755242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.755497 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.811937 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] MFA Rules not processed for user `5f969e4f1fa14be186b3b188e2f38fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:11.814806 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:11.986029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1161/2300] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:11.989689 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.160318 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594bead-b39c-492a-9dbe-aa01872d2d7c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.166111 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.166742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.167589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.167868 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.168516 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.170545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.226342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1140/2301] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:12.233784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.242045 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:12.265783 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdb50e-a0bb-426d-bbb5-202b28f652f2 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.400576 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.401237 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.407761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.408103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.408855 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.410963 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.455842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1162/2302] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:12 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:12.459723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.489461 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803634b5-5d43-4ceb-9d26-7606d7d0d6ae admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.511719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.512526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.512818 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.513115 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.513751 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.515407 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.554495 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1141/2303] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:12.556933 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.576985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1e83-ff4b-480c-97eb-e06074d2ce17 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.593448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.594184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.594467 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.594733 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] PATH_INFO: `/v3/projects/7613457d4eed42f3add82f8c51a723a0/users/98ffbec94c8840d19a0ec604a422e119/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.622880 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7613457d4eed42f3add82f8c51a723a0, user_id=98ffbec94c8840d19a0ec604a422e119, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.625461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.643652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1163/2304] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:12 2022] PUT /identity/v3/projects/7613457d4eed42f3add82f8c51a723a0/users/98ffbec94c8840d19a0ec604a422e119/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:12.647595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.668644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5742-fa29-4b91-9975-08207f24a251 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.778712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.779622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.779622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.779622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.781129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.784571 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b56b0-c4bb-4b3a-b867-fda190da6a0b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.820183 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:12.832954 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1142/2305] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:12.843487 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa5dc-22db-4a55-b957-d7328a26b9df admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:12.862016 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:12.862590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.865935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.866246 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] PATH_INFO: `/v3/projects/7613457d4eed42f3add82f8c51a723a0/users/98ffbec94c8840d19a0ec604a422e119/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:12.876461 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7613457d4eed42f3add82f8c51a723a0, user_id=98ffbec94c8840d19a0ec604a422e119, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:12.883572 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:12.933280 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1164/2306] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:12 2022] PUT /identity/v3/projects/7613457d4eed42f3add82f8c51a723a0/users/98ffbec94c8840d19a0ec604a422e119/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:12.944194 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:12.944683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:12.945179 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:13.034412 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] MFA Rules not processed for user `98ffbec94c8840d19a0ec604a422e119`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:13.036251 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:13.076721 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:13.288308 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1143/2307] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:13.341999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:13.343757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:13.440279 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c03e-da9f-478f-a3e0-f95e8b5aed3e admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:13.444220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:13.444845 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:13.445123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:13.445392 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:13.456697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:13.458419 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:13.474025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1165/2308] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:13.661131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:13.689847 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284a32-54ea-427b-96e0-46c4a9c9a6e0 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:13.709184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:13.710360 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:13.710858 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:13.711601 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:13.811188 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:13.812975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18b91f-902f-46ec-89f0-f88873a28615 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:13.825180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1144/2309] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:17.250475 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:17.252003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:17.409241 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:17.418242 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6495a-5238-4b08-ada1-009ba285d0f2 service cinder] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:17.424652 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:17.425504 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:17.426212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:17.426632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] PATH_INFO: `/v3/users/cc4eeffdb6a44525a6012700db29148f` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:17.428408 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4eeffdb6a44525a6012700db29148f)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:17.430946 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:17.527054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4eeffdb6a44525a6012700db29148f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:17.538421 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4eeffdb6a44525a6012700db29148f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:17.571737 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4eeffdb6a44525a6012700db29148f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:17.572405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4eeffdb6a44525a6012700db29148f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:17.573691 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4eeffdb6a44525a6012700db29148f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:17.594994 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1166/2310] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:17 2022] DELETE /identity/v3/users/cc4eeffdb6a44525a6012700db29148f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:17.599833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:17.600916 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:17.601546 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:17.663683 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:17.670016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:17.805712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1145/2311] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:17.816610 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:17.818422 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:17.983485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da295-6b5d-481f-a511-18b5e7250ea1 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:17.994735 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:17.996314 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:17.996759 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:17.997484 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:18.027501 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:18.029041 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:18.058295 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1167/2312] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:18.302710 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:18.304294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:18.325313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d1541-77da-42ba-8c2a-1f5413369d0f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:18.345560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:18.347489 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:18.350539 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:18.351019 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] PATH_INFO: `/v3/users/5f969e4f1fa14be186b3b188e2f38fe2` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:18.353351 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f969e4f1fa14be186b3b188e2f38fe2)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:18.357367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:18.437694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:18.439222 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:18.445658 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:18.450014 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f969e4f1fa14be186b3b188e2f38fe2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.464823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f969e4f1fa14be186b3b188e2f38fe2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.466243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81046e56-91d1-4fb2-a634-9d166da736c2 service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:18.466650 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f969e4f1fa14be186b3b188e2f38fe2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.479650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:18.483559 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:18.483999 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:18.484335 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] PATH_INFO: `/v3/projects/187929dfb6584e3096f03d8c82e9f950` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:18.487197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187929dfb6584e3096f03d8c82e9f950)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:18.494448 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:18.507657 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f969e4f1fa14be186b3b188e2f38fe2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.508588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-a3899ed6-03c7-4cd1-a5cf-102ef11c799b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f969e4f1fa14be186b3b188e2f38fe2'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.542794 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1146/2313] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:18 2022] DELETE /identity/v3/users/5f969e4f1fa14be186b3b188e2f38fe2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:18.546353 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:18.546641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:18.546919 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:18.597447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:18.598717 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:18.627905 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187929dfb6584e3096f03d8c82e9f950', 'request_id': 'req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.639654 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187929dfb6584e3096f03d8c82e9f950', 'request_id': 'req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.680705 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187929dfb6584e3096f03d8c82e9f950', 'request_id': 'req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.688591 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1147/2314] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:18.696995 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:18.699833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:18.718068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] The token cache is being invalidate because project 187929dfb6584e3096f03d8c82e9f950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:18.718068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.718068 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:18.719227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1168/2315] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:18 2022] DELETE /identity/v3/projects/187929dfb6584e3096f03d8c82e9f950 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:45:18.802236 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce2c45-c492-48b7-bbcc-fc234563ab63 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:18.809476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:18.810222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:18.810508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:18.810985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:18.813428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:18.829595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:18.833817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:18.848738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1148/2316] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:19.298104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:19.302131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:19.313103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:19.323268 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb32884-7ccf-4fa7-ad4a-f69b873693b0 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:19.339587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:19.339587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:19.353164 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:19.353738 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] PATH_INFO: `/v3/projects/304ffc2b090f4931b3a8931a9260b78a` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:19.359862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304ffc2b090f4931b3a8931a9260b78a)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:19.363718 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:19.434980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304ffc2b090f4931b3a8931a9260b78a', 'request_id': 'req-4db55a8f-b17d-47a5-9eff-e4094e29ae76'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.442740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304ffc2b090f4931b3a8931a9260b78a', 'request_id': 'req-4db55a8f-b17d-47a5-9eff-e4094e29ae76'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.455574 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304ffc2b090f4931b3a8931a9260b78a', 'request_id': 'req-4db55a8f-b17d-47a5-9eff-e4094e29ae76'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.484885 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] The token cache is being invalidate because project 304ffc2b090f4931b3a8931a9260b78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:19.485690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.486753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.489411 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1169/2317] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:19 2022] DELETE /identity/v3/projects/304ffc2b090f4931b3a8931a9260b78a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:19.496697 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:19.512821 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3d84-483a-47ef-8747-ceb33d9b5684 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:19.601187 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:19.601908 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:19.602283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:19.602563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] PATH_INFO: `/v3/users/98ffbec94c8840d19a0ec604a422e119` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:19.607315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ffbec94c8840d19a0ec604a422e119)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:19.609913 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:19.619616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:19.691500 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ffbec94c8840d19a0ec604a422e119'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.714476 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ffbec94c8840d19a0ec604a422e119'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.715553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ffbec94c8840d19a0ec604a422e119'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.747750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ffbec94c8840d19a0ec604a422e119'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.751811 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-137743b9-bf79-4622-b45b-a4edcc929b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ffbec94c8840d19a0ec604a422e119'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:19.779371 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1149/2318] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:19 2022] DELETE /identity/v3/users/98ffbec94c8840d19a0ec604a422e119 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:20.158941 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:20.160488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:20.187909 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55a8f-b17d-47a5-9eff-e4094e29ae76 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:20.306744 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:20.310761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.311220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.311560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] PATH_INFO: `/v3/projects/7613457d4eed42f3add82f8c51a723a0` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.315032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7613457d4eed42f3add82f8c51a723a0)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:20.317859 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:20.398138 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7613457d4eed42f3add82f8c51a723a0', 'request_id': 'req-67ede85c-c986-498b-b969-c6244f286cb4'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:20.407793 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7613457d4eed42f3add82f8c51a723a0', 'request_id': 'req-67ede85c-c986-498b-b969-c6244f286cb4'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:20.418834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7613457d4eed42f3add82f8c51a723a0', 'request_id': 'req-67ede85c-c986-498b-b969-c6244f286cb4'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:20.441871 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] The token cache is being invalidate because project 7613457d4eed42f3add82f8c51a723a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81790) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:20.442445 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:20.443111 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-67ede85c-c986-498b-b969-c6244f286cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:20.445048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1170/2319] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:20 2022] DELETE /identity/v3/projects/7613457d4eed42f3add82f8c51a723a0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:20.450636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.451068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.451464 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.476953 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:20.478274 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:20.578077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1150/2320] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:20.578332 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.578598 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.578879 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.608768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:20.610315 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:20.622826 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1171/2321] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:20.627671 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:20.657718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fa64-9690-4b87-8ff5-1518e959ca7c None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:20.685299 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:20.686150 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.686491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.686836 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.687577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:45:20.687914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:20.691893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:20.713349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:20.719914 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1151/2322] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:45:20.724029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa6eb-bcba-4721-a1cd-98d3117f9632 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:20.730108 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:20.730740 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.731017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.731336 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.731987 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:20.735103 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:20.742033 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:20.783217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1172/2323] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:20 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:20.783560 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:20.796012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339cd3e-569c-4c01-a692-56497d3be3a3 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:20.909764 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:20.910437 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.910722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.911018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] PATH_INFO: `/v3/users` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.911980 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:20.913783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:20.935442 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:20.948440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1152/2324] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:20 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:45:20.949903 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:20.963794 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71b82-5017-47ef-b3a5-a717226396e9 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:20.969891 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:20.973058 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:20.973724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:20.974184 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:20.975145 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:20.976926 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:20.997552 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1173/2325] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:20.998169 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.009834 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09c746-6655-4be8-bbf5-fa7b6f41120e admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.015988 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.016616 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.016903 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.017180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.018064 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.019737 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81ab47-047a-4547-815e-e1d195f8d2fb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.040595 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1153/2326] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:21.041784 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.055600 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891c6f-79d4-412a-838a-7e678466bd44 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.060761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.062757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.062757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.062757 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] PATH_INFO: `/v3/projects/23e5a9c8ad21478ea577f0d62291e785/users/3a53c6fd71e94d8c947e06466118a66f/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.079560 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e5a9c8ad21478ea577f0d62291e785, user_id=3a53c6fd71e94d8c947e06466118a66f, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.084682 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a63b3-77e7-4a5a-8b62-b8f45b5d4a10 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.104052 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1174/2327] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:21 2022] PUT /identity/v3/projects/23e5a9c8ad21478ea577f0d62291e785/users/3a53c6fd71e94d8c947e06466118a66f/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:21.119641 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.119990 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.120271 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.164474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] MFA Rules not processed for user `3a53c6fd71e94d8c947e06466118a66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:21.165752 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:21.210488 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.210888 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.211168 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.242915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] MFA Rules not processed for user `b78f02ca2e7a4a0792e7b4e685c6f7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:21.244282 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:21.301219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1154/2328] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:21.306168 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.353512 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1175/2329] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:21.437812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc52eb-504c-4a23-9605-ec6f0a612482 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.444218 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.445180 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.446139 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.447032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.447896 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.452065 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.498556 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1155/2330] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:21 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:21.503931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.536904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad836-6f22-47f8-b675-283c29cd8510 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.662590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.663327 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.663617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.663894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.664858 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.672398 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.713485 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1176/2331] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:21 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:45:21.720049 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.752897 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644361a-8a14-4055-bd56-998acc064187 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.767646 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.768840 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.773563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.773563 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.774948 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.778588 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.806783 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1156/2332] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:21.811599 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.826834 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa306bf-3a14-42a4-824c-64242af61d96 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:21.839320 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:21.840189 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:21.840645 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:21.841082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] PATH_INFO: `/v3/projects/94001a869e5048f98583f05226ad12db/users/19670cadb1c5455b87a17a21d4bee0e2/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:21.870418 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94001a869e5048f98583f05226ad12db, user_id=19670cadb1c5455b87a17a21d4bee0e2, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:21.873364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:21.898899 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1177/2333] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:21 2022] PUT /identity/v3/projects/94001a869e5048f98583f05226ad12db/users/19670cadb1c5455b87a17a21d4bee0e2/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:21.904304 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:21.927491 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ea170-f3db-4980-a4b7-175e61d4ed6c admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:22.017182 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:22.031964 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:22.032685 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:22.033040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:22.033401 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:22.034199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:22.036033 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae47c1-2605-4a4c-aad6-b80bd4696fe6 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:22.049825 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1157/2334] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:22.055032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:22.072612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1e0d5-8761-47f5-bb41-f52b194f3c01 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:22.082196 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:22.083003 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:22.083393 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:22.083770 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] PATH_INFO: `/v3/projects/94001a869e5048f98583f05226ad12db/users/19670cadb1c5455b87a17a21d4bee0e2/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:22.085983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94001a869e5048f98583f05226ad12db, user_id=19670cadb1c5455b87a17a21d4bee0e2, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:22.089570 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:22.110982 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1178/2335] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:22 2022] PUT /identity/v3/projects/94001a869e5048f98583f05226ad12db/users/19670cadb1c5455b87a17a21d4bee0e2/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:22.113315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:22.113854 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:22.114201 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:22.150060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] MFA Rules not processed for user `19670cadb1c5455b87a17a21d4bee0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:22.152524 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:22.274452 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1158/2336] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:22.292532 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:22.294792 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:22.314017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:22.393493 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23609f-b23f-4570-b4fb-e11fe03d918f admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:22.397378 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:22.398675 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:22.398814 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:22.399096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:22.409985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:22.411469 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df5c7-654e-4286-bf2a-1ad23cda6e0c service cinder] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:22.442010 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1179/2337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:23.098985 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:23.209987 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e81e-9738-4915-aadc-cb7d73906c4d None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:23.215600 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:23.216447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:23.216830 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:23.217213 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] PATH_INFO: `/v3/users/3a53c6fd71e94d8c947e06466118a66f` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:23.219060 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a53c6fd71e94d8c947e06466118a66f)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:23.221534 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:23.294408 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a53c6fd71e94d8c947e06466118a66f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:23.302527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a53c6fd71e94d8c947e06466118a66f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:23.303226 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a53c6fd71e94d8c947e06466118a66f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:23.316736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a53c6fd71e94d8c947e06466118a66f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:23.317490 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a53c6fd71e94d8c947e06466118a66f'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:23.322672 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:23.333163 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1159/2338] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:23 2022] DELETE /identity/v3/users/3a53c6fd71e94d8c947e06466118a66f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:23.342444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb80ea-fec6-4b64-90d5-84d3fb3ffaed None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:23.343056 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb80ea-fec6-4b64-90d5-84d3fb3ffaed None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:23.343211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb80ea-fec6-4b64-90d5-84d3fb3ffaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:23.366048 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-e6eb80ea-fec6-4b64-90d5-84d3fb3ffaed None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:23.367376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-e6eb80ea-fec6-4b64-90d5-84d3fb3ffaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:23.441338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1180/2339] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:23.452802 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:23.454494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:23.527167 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1992-4b50-4b45-bc53-b2d89cc289cb admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:23.531453 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:23.532174 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:23.532508 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:23.532975 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:23.547101 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:23.549100 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:23.553326 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:23.553616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:23.553895 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:23.572909 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1160/2340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:23.580366 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] MFA Rules not processed for user `375f60710e5e4cffb6f186ac3d49ac4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:23.581726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:23.669588 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1181/2341] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:24.091723 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:24.095712 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:24.145504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d727f99-65b9-4d67-a0f0-72efe96ed2f0 service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:24.150531 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:24.151223 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:24.151659 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:24.151943 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] PATH_INFO: `/v3/projects/23e5a9c8ad21478ea577f0d62291e785` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:24.153105 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e5a9c8ad21478ea577f0d62291e785)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:24.155035 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:24.214883 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e5a9c8ad21478ea577f0d62291e785', 'request_id': 'req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.222769 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e5a9c8ad21478ea577f0d62291e785', 'request_id': 'req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.233334 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e5a9c8ad21478ea577f0d62291e785', 'request_id': 'req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.246797 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] The token cache is being invalidate because project 23e5a9c8ad21478ea577f0d62291e785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:24.247184 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.247923 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.250389 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1161/2342] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:24 2022] DELETE /identity/v3/projects/23e5a9c8ad21478ea577f0d62291e785 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:24.254462 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:24.266586 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90389c94-161f-4f32-a05a-6757ac389297 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:24.347612 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=100 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:24.358231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:24.359904 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:24.362208 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:24.362694 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] PATH_INFO: `/v3/users/19670cadb1c5455b87a17a21d4bee0e2` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:24.364993 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=19670cadb1c5455b87a17a21d4bee0e2)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:24.367325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:24.466156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19670cadb1c5455b87a17a21d4bee0e2'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.503876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19670cadb1c5455b87a17a21d4bee0e2'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.520231 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19670cadb1c5455b87a17a21d4bee0e2'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.520980 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19670cadb1c5455b87a17a21d4bee0e2'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.522578 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-aa69123a-1dac-49f3-841f-c5ae7c45bcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19670cadb1c5455b87a17a21d4bee0e2'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:24.558039 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1182/2343] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:24 2022] DELETE /identity/v3/users/19670cadb1c5455b87a17a21d4bee0e2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:24.939892 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:24.942245 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:24.976584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a82a1a-0777-40ed-a473-ee4a7e5fe3a1 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.047050 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.047607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.047889 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.048164 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] PATH_INFO: `/v3/projects/94001a869e5048f98583f05226ad12db` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.049296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94001a869e5048f98583f05226ad12db)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.051296 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.076718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:25.121232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94001a869e5048f98583f05226ad12db', 'request_id': 'req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:25.128419 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94001a869e5048f98583f05226ad12db', 'request_id': 'req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:25.143454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94001a869e5048f98583f05226ad12db', 'request_id': 'req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:25.157123 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] The token cache is being invalidate because project 94001a869e5048f98583f05226ad12db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:25.157807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:25.158114 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-fb0f2c10-fb3d-43d7-ab5f-24fa34a52456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:25.163012 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1162/2344] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:24 2022] DELETE /identity/v3/projects/94001a869e5048f98583f05226ad12db => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:25.164543 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.164833 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.165110 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.190928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:25.192211 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:25.276017 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1183/2345] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:25.283732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.284219 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.285018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.309441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:25.310779 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:25.326008 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1163/2346] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:25.327197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.338964 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f80bf6-d92b-4745-a6fb-daf03adb0973 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.344813 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.345434 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.345785 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.346136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.347169 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:45:25.347866 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.350975 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.366596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1184/2347] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:45:25.375394 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.386504 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e824f-c1ce-44bc-8638-08eefa9db2f8 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.391942 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.392778 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.393288 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.393781 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.394877 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.397719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.456029 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1164/2348] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:25 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:25.461351 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.476928 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d64e-87b4-41d8-bca7-e76de7e76767 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.595305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.595952 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.596217 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.596524 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.597159 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.599227 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.637703 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:25.670065 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1185/2349] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:25 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:25.672511 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.702636 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0480fc-d0eb-44ba-b9da-4c2e28f98d2d admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.730068 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.730613 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.732032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.732317 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.734257 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.736966 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.766006 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1165/2350] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:25.769893 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.784897 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ca89-b389-4b05-ba27-fa6b4021e566 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.821220 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.822413 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.822955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.823458 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.824614 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.827846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb617df-00ea-48fe-a0f6-607f49fd4861 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.874662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:25.896347 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1186/2351] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:25.900707 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79f232-143f-4ad2-af74-2e44216321a8 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:25.907444 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:25.908202 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.908558 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.908910 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] PATH_INFO: `/v3/projects/f7284881534f444b9e6691b8cf79e90f/users/7858c163d1634a84bb7fca7399fcfacf/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.933537 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7284881534f444b9e6691b8cf79e90f, user_id=7858c163d1634a84bb7fca7399fcfacf, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:25.937053 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:25.956398 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1166/2352] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:25 2022] PUT /identity/v3/projects/f7284881534f444b9e6691b8cf79e90f/users/7858c163d1634a84bb7fca7399fcfacf/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:25.962113 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea44db-a3e5-4766-b7d1-3aeeef024c42 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:25.963083 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea44db-a3e5-4766-b7d1-3aeeef024c42 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:25.963395 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea44db-a3e5-4766-b7d1-3aeeef024c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:25.987349 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-05ea44db-a3e5-4766-b7d1-3aeeef024c42 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:25.988558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-05ea44db-a3e5-4766-b7d1-3aeeef024c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:26.067062 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1187/2353] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:26.076365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:26.078024 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:26.155206 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ddaa-904a-48b4-a537-d4cc749e26ee admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:26.160378 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:26.161438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.161438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.162320 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.172199 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:26.173676 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:26.183690 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1167/2354] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:26.947104 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.947568 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.948019 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.980322 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] MFA Rules not processed for user `7858c163d1634a84bb7fca7399fcfacf`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:26.981870 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:27.078729 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1188/2355] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:27.083018 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.095644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771df50-fcfc-493f-a5f4-5d532650a63a service neutron] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.102492 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.103738 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.104869 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.105337 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.106450 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.109238 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.149776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1168/2356] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:27 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:45:27.154472 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.168206 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c32d-e11f-4eaa-8cfc-c1fb67e5f6cd None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.239655 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.240616 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.241090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.241558 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.242460 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.244447 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.305526 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1189/2357] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:27 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:27.310239 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.324696 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4740b-4ef5-4a47-b51b-1c8f21ca8162 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.331692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.332700 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.333220 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.333719 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.334644 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.336505 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.352341 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1169/2358] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:45:27.355862 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.363690 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:27.373719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef96e9-3aae-45c6-b635-a1cb3fe9d6a5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.379951 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.381121 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.381583 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.382305 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] PATH_INFO: `/v3/projects/579e8c559bee431ea77131fddc6a3fac/users/654188e20fdf419b8ffc8055d7a7ea7f/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.405727 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579e8c559bee431ea77131fddc6a3fac, user_id=654188e20fdf419b8ffc8055d7a7ea7f, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.410638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.433307 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1190/2359] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:27 2022] PUT /identity/v3/projects/579e8c559bee431ea77131fddc6a3fac/users/654188e20fdf419b8ffc8055d7a7ea7f/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:27.437316 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.447735 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07426121-7c4b-48ee-a675-b87aca3649ab admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.461545 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:27.515416 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.516043 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.516322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.516622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.517276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.518935 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7022-5ab6-472f-b2e0-dfcf76781080 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.530693 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1170/2360] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:27.535267 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.547001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af89f5-04c6-45f9-b079-3a5c2646f1e8 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:27.551959 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:27.552714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.553060 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.553446 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] PATH_INFO: `/v3/projects/579e8c559bee431ea77131fddc6a3fac/users/654188e20fdf419b8ffc8055d7a7ea7f/roles/bedd80585f4d4d049e3918a1568f5a9d` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.555628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=579e8c559bee431ea77131fddc6a3fac, user_id=654188e20fdf419b8ffc8055d7a7ea7f, role_id=bedd80585f4d4d049e3918a1568f5a9d)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:27.559086 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:27.570564 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1191/2361] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:27 2022] PUT /identity/v3/projects/579e8c559bee431ea77131fddc6a3fac/users/654188e20fdf419b8ffc8055d7a7ea7f/roles/bedd80585f4d4d049e3918a1568f5a9d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:27.663579 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef11a-e12c-48bc-93af-07912bbdc4e5 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:27.664370 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef11a-e12c-48bc-93af-07912bbdc4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:27.666081 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef11a-e12c-48bc-93af-07912bbdc4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:27.702542 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-458ef11a-e12c-48bc-93af-07912bbdc4e5 None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:27.703837 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-458ef11a-e12c-48bc-93af-07912bbdc4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:27.845997 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1171/2362] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:27.861152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:27.862953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:27.994947 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617045-2b1b-497f-ad9d-1323a6418ddf admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:28.004731 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:28.005842 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:28.022131 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:28.023245 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:28.045815 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:28.048194 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:28.063760 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1192/2363] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:28.892952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f614d-9ac1-4af9-80cd-e18bacbf4122 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:28.893952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f614d-9ac1-4af9-80cd-e18bacbf4122 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:28.894415 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f614d-9ac1-4af9-80cd-e18bacbf4122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:28.929224 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-dc6f614d-9ac1-4af9-80cd-e18bacbf4122 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:28.930725 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-dc6f614d-9ac1-4af9-80cd-e18bacbf4122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.058170 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1172/2364] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:29.081325 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:29.083116 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.254573 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae2646-26a7-4ee8-9b0e-42f7dbe0537d service swift] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:29.260518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:29.261136 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.261420 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.261725 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.271811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:29.273500 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167a7f-1634-470f-9020-48ff2b6cb6d5 service nova] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:29.289650 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1193/2365] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:29.439718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.440007 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.440283 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.504435 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] MFA Rules not processed for user `654188e20fdf419b8ffc8055d7a7ea7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:29.505823 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.587032 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=100 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:29.640322 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1173/2366] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:29.655978 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2531-a3ab-40f5-9284-bd1837d34b50 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.656499 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2531-a3ab-40f5-9284-bd1837d34b50 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.656856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2531-a3ab-40f5-9284-bd1837d34b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.699190 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b37a2531-a3ab-40f5-9284-bd1837d34b50 None None] MFA Rules not processed for user `7858c163d1634a84bb7fca7399fcfacf`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:29.700405 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b37a2531-a3ab-40f5-9284-bd1837d34b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.777948 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:29.823985 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1194/2367] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:29.931576 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:29.934292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.963292 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c711804-ac6a-41a6-aac9-641c91f2c626 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:29.977365 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:29.982256 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.982587 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.982870 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.996379 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:30.005315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:30.021258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1174/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:39.810425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=7 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:40.013470 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=14 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:42.334050 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad30a-a0c4-46c6-afed-3783086ea0ad None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:42.334518 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad30a-a0c4-46c6-afed-3783086ea0ad None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:42.334617 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad30a-a0c4-46c6-afed-3783086ea0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:42.354590 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-f87ad30a-a0c4-46c6-afed-3783086ea0ad None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:42.356635 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f87ad30a-a0c4-46c6-afed-3783086ea0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:42.366481 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1195/2369] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:42.391523 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:42.402947 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62427858-7785-4844-94f7-95fdb0e529ba service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:42.408750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:42.409349 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:42.409628 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:42.409901 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:42.419132 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:42.420722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:42.430512 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1175/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:46.600071 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30a65e-3272-4919-b82a-a4c5daad9b36 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:46.600606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30a65e-3272-4919-b82a-a4c5daad9b36 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:46.600606 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30a65e-3272-4919-b82a-a4c5daad9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:46.620686 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-9d30a65e-3272-4919-b82a-a4c5daad9b36 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:46.621900 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-9d30a65e-3272-4919-b82a-a4c5daad9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:46.630290 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1196/2371] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:46.654705 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:46.665894 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685801-0378-4096-a58c-348162c4cf40 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:46.672128 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:46.672747 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:46.673034 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:46.673313 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:46.682112 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:46.683718 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:46.694311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1176/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:48.249936 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2098-5582-4246-abab-8b82b6a4dbeb None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:48.250837 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2098-5582-4246-abab-8b82b6a4dbeb None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:48.251123 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2098-5582-4246-abab-8b82b6a4dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:48.280338 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c26b2098-5582-4246-abab-8b82b6a4dbeb None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:48.282044 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c26b2098-5582-4246-abab-8b82b6a4dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:48.296983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1197/2373] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:48.304911 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:48.323905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b24d8-9ead-44fb-8130-e38d4ee1fbff service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:48.330104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:48.331005 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:48.331474 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:48.331941 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:48.341795 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:48.343986 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:48.354263 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1177/2374] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:50.821819 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248c84-d943-414b-bf90-181e63775490 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:50.822490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248c84-d943-414b-bf90-181e63775490 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:50.822490 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0248c84-d943-414b-bf90-181e63775490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:50.878360 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-d0248c84-d943-414b-bf90-181e63775490 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:50.880376 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d0248c84-d943-414b-bf90-181e63775490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:50.895983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1198/2375] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:50.999276 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:51.026057 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031bb2-1466-4de9-92f2-0d59de2879e5 service swift] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:51.034346 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:51.035158 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:51.035736 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:51.036232 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:51.055122 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:51.057421 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:51.083728 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1178/2376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:56.136736 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85f58-a9d6-4cb4-bd92-ce28ad2220ef None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:56.137253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85f58-a9d6-4cb4-bd92-ce28ad2220ef None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:56.137337 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85f58-a9d6-4cb4-bd92-ce28ad2220ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:56.165090 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c4f85f58-a9d6-4cb4-bd92-ce28ad2220ef None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:56.166983 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c4f85f58-a9d6-4cb4-bd92-ce28ad2220ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:56.181554 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1199/2377] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:56.203758 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:56.228589 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deae4e8-10ad-4df4-9782-7a982180e539 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:56.245374 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:56.246281 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:56.247129 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:56.247893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:56.271363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:56.273315 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:56.285008 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1179/2378] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:01.381285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:01.381841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:01.381841 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:01.400988 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:01.402262 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:01.410212 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1200/2379] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:01.436782 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:01.447925 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a5e7-56c4-4f0b-965d-651dcf3134c0 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:01.453455 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:01.454095 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:01.454377 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:01.454653 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:01.462666 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:01.464742 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:01.474104 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1180/2380] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:05.708186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:05.766587 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c704-8e88-4498-80ab-aeda97e9cf4f None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:05.770605 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:05.771253 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:05.771537 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:05.771811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:05.773632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:05.841063 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:05.842536 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633033-0eed-41e2-bbac-300c35ead532 service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:05.852768 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1201/2381] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:06.088662 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:06.090631 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:06.164972 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bbe2-015a-4cba-98a2-b4c6fa92c42e service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:06.172454 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17712d9631894617aa1011ac36582543', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:06.174146 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:06.175607 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:06.175900 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:06.188131 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:06.189688 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671ce88-b92c-412c-afc2-7934e267cce7 service cinder] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:06.201258 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1181/2382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:10.522254 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.522827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.522827 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.524177 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1202/2383] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:46:10.535467 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23866-3a86-4f55-ba4a-8b91fc1f4fcb None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.536803 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23866-3a86-4f55-ba4a-8b91fc1f4fcb None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.537369 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23866-3a86-4f55-ba4a-8b91fc1f4fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.550367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=63 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:10.566572 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-b5b23866-3a86-4f55-ba4a-8b91fc1f4fcb None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:10.567816 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b5b23866-3a86-4f55-ba4a-8b91fc1f4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:10.592647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1182/2384] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:10.593846 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:10.597156 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:10.605609 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=69 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:10.734483 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fc90-ef1a-4057-a699-f8f4a08797ec None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:10.739001 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a994eec4a44b782d847b132c6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:10.739632 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.739915 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.740186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.755192 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:10.756953 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a76a9a-9c12-4bfe-a344-fe895e6d387d service glance] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:10.772005 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1203/2385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:46:10.862009 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd45f1c-5ad8-4650-a664-37dc237379f2 None None] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.862673 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd45f1c-5ad8-4650-a664-37dc237379f2 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.863291 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd45f1c-5ad8-4650-a664-37dc237379f2 None None] PATH_INFO: `/` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.864760 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1183/2386] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:46:10.871628 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408ea8c-2943-4111-86c3-147337067414 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.871913 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408ea8c-2943-4111-86c3-147337067414 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.872363 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408ea8c-2943-4111-86c3-147337067414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.895872 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-3408ea8c-2943-4111-86c3-147337067414 None None] MFA Rules not processed for user `8908fc8044dc4428a53ef40cbcdff4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:10.897823 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-3408ea8c-2943-4111-86c3-147337067414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:10.905377 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1204/2387] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:10.919428 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd45f1c-5ad8-4650-a664-37dc237379f2 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:10.932813 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd45f1c-5ad8-4650-a664-37dc237379f2 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:10.937413 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:10.938077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:10.938905 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:10.939350 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:10.948447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:10.950422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483905e-7c49-4d1b-88db-836a28e1d38c service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:10.960711 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1184/2388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:11.065685 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275b-2509-4fd2-9edb-03e842243114 None None] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.066463 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275b-2509-4fd2-9edb-03e842243114 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.066954 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275b-2509-4fd2-9edb-03e842243114 None None] PATH_INFO: `/` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.068608 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1205/2389] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 15:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:46:11.076077 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67f61-00f4-4845-8cc1-0f4f7e4edd78 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.077028 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67f61-00f4-4845-8cc1-0f4f7e4edd78 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.077553 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67f61-00f4-4845-8cc1-0f4f7e4edd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.107633 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-65e67f61-00f4-4845-8cc1-0f4f7e4edd78 None None] MFA Rules not processed for user `ba7d3b76b6b746f1b1c2585feef177b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:11.109254 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-65e67f61-00f4-4845-8cc1-0f4f7e4edd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:11.122084 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1185/2390] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:11.133865 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6275b-2509-4fd2-9edb-03e842243114 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:11.150172 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6275b-2509-4fd2-9edb-03e842243114 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:11.154387 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:11.155082 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.155456 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.155798 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.168099 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:11.169649 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:11.183117 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1206/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:19.910822 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559771d-8e17-4a6b-91e5-782bfd7da12d None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:19.911582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559771d-8e17-4a6b-91e5-782bfd7da12d None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:19.911582 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559771d-8e17-4a6b-91e5-782bfd7da12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:19.939583 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-a559771d-8e17-4a6b-91e5-782bfd7da12d None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:19.940812 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-a559771d-8e17-4a6b-91e5-782bfd7da12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:19.948776 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1186/2392] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:19.971274 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:19.982436 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8489-5ad9-4219-ad74-87df00afedac service neutron] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:19.987391 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:19.987984 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:19.988264 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:19.988535 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:19.996593 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:19.998239 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:20.005971 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1207/2393] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:46:24.417373 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:24.418040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:24.418040 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:24.437895 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] MFA Rules not processed for user `b43d08ccaf7f41a8825e20b3ada92ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:24.439149 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:24.498677 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1187/2394] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:46:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:30.002938 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=40 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:34.490159 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=39 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:34.706981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:34.734596 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2de981-e1e2-4d09-8c38-7fd8154b486a service swift] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:34.739505 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:34.740155 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:34.740438 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:34.740712 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] PATH_INFO: `/v3/users/7858c163d1634a84bb7fca7399fcfacf` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:34.742197 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7858c163d1634a84bb7fca7399fcfacf)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:34.744193 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:34.804444 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7858c163d1634a84bb7fca7399fcfacf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:34.813828 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7858c163d1634a84bb7fca7399fcfacf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:34.827233 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7858c163d1634a84bb7fca7399fcfacf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:34.828032 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7858c163d1634a84bb7fca7399fcfacf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:34.828719 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7858c163d1634a84bb7fca7399fcfacf'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:34.850054 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1208/2395] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:46:34 2022] DELETE /identity/v3/users/7858c163d1634a84bb7fca7399fcfacf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:35.076237 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:35.087294 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2769-ea48-41ff-a62c-9a3dbea6a03f None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:35.145483 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:35.146189 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.146479 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.146755 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] PATH_INFO: `/v3/projects/f7284881534f444b9e6691b8cf79e90f` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.147874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7284881534f444b9e6691b8cf79e90f)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:35.149768 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:35.204775 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7284881534f444b9e6691b8cf79e90f', 'request_id': 'req-b1ac0ffa-b4c7-41e8-89da-767fd837b299'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.211307 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7284881534f444b9e6691b8cf79e90f', 'request_id': 'req-b1ac0ffa-b4c7-41e8-89da-767fd837b299'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.220311 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7284881534f444b9e6691b8cf79e90f', 'request_id': 'req-b1ac0ffa-b4c7-41e8-89da-767fd837b299'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.232298 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] The token cache is being invalidate because project f7284881534f444b9e6691b8cf79e90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:46:35.232611 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.233338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.234893 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1188/2396] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:46:35 2022] DELETE /identity/v3/projects/f7284881534f444b9e6691b8cf79e90f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:35.238939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:35.241202 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:35.254449 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918b01-3808-4947-84b9-2fa5f76f18b2 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:35.321935 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:35.322638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.322918 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.323714 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] PATH_INFO: `/v3/users/654188e20fdf419b8ffc8055d7a7ea7f` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.324955 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654188e20fdf419b8ffc8055d7a7ea7f)` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:35.327029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:35.402981 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654188e20fdf419b8ffc8055d7a7ea7f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.411078 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654188e20fdf419b8ffc8055d7a7ea7f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.425101 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654188e20fdf419b8ffc8055d7a7ea7f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.425876 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654188e20fdf419b8ffc8055d7a7ea7f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.426697 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.notifications [None req-b8423937-f24a-454c-a2e8-65b51f4fbab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654188e20fdf419b8ffc8055d7a7ea7f'} {{(pid=81790) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.428779 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:35.441375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1209/2397] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 15:46:35 2022] DELETE /identity/v3/users/654188e20fdf419b8ffc8055d7a7ea7f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:35.637022 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:35.638732 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:35.651817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac0ffa-b4c7-41e8-89da-767fd837b299 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:35.723110 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:35.723855 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.724175 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.724447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] PATH_INFO: `/v3/projects/579e8c559bee431ea77131fddc6a3fac` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.725584 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=579e8c559bee431ea77131fddc6a3fac)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:35.727501 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:35.764833 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:35.779845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579e8c559bee431ea77131fddc6a3fac', 'request_id': 'req-1827f911-1533-4e03-b371-cedc160008aa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.786867 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579e8c559bee431ea77131fddc6a3fac', 'request_id': 'req-1827f911-1533-4e03-b371-cedc160008aa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.795617 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579e8c559bee431ea77131fddc6a3fac', 'request_id': 'req-1827f911-1533-4e03-b371-cedc160008aa'} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.808904 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] The token cache is being invalidate because project 579e8c559bee431ea77131fddc6a3fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:46:35.809203 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.810214 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.notifications [None req-1827f911-1533-4e03-b371-cedc160008aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:35.811819 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1189/2398] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 15:46:35 2022] DELETE /identity/v3/projects/579e8c559bee431ea77131fddc6a3fac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:35.816677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.817167 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.817266 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.846508 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:35.847726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:35.906096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1210/2399] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:35.921363 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.921652 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.922003 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.943441 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.auth.core [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:35.944695 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:35.952763 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1190/2400] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:35.956995 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:35.966629 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7cdb-e976-425f-a189-4a5523e793b5 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:35.971152 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:35.971745 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:35.972025 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:35.972298 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] PATH_INFO: `/v3/domains` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:35.972949 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81790) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:46:35.973251 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:35.974856 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:35.986503 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1211/2401] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 15:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:46:35.990805 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.000807 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995caf-e6cd-46af-a32c-c87287133488 None None] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.005496 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.006135 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.006422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.006699 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.007347 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.009241 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.036957 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1191/2402] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 15:46:35 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:46:36.040990 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.051940 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59f94d-dfd0-45dc-ad69-d5e93f4b1772 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.111811 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.112528 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.112816 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.113096 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.113748 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.115720 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.138799 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1212/2403] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 15:46:36 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:46:36.143030 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.153991 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab893a-01e3-4a67-b7e8-f8c1b6abb2cf admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.158969 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.159590 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.159874 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.160153 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.160817 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.162527 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.178348 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1192/2404] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:46:36.179562 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.190166 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ce8bd-41ec-42ed-9f58-01bc618006f5 admin admin] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.195186 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.196076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.196076 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.196375 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.197126 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.199997 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da6b3d-5f66-4551-8588-abaf86a66d6b admin admin] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.211516 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1213/2405] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 15:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:46:36.215692 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.225746 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b9ae-07e8-4736-ab04-aeec6253ac5b admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.230519 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '824d2e5db1534ae296c3e88c19fcec31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05e98dd4fc624f4b8d51679e7ec2d59b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.231166 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.231446 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.231720 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] PATH_INFO: `/v3/projects/f7fb06c69c8e467e903f148df8310957/users/5a9dca97ed4345f3992c41312d9031c4/roles/6768cc46246246b384f2ab1b1e4861aa` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.246944 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fb06c69c8e467e903f148df8310957, user_id=5a9dca97ed4345f3992c41312d9031c4, role_id=6768cc46246246b384f2ab1b1e4861aa)` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.249622 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.264581 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1193/2406] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 15:46:36 2022] PUT /identity/v3/projects/f7fb06c69c8e467e903f148df8310957/users/5a9dca97ed4345f3992c41312d9031c4/roles/6768cc46246246b384f2ab1b1e4861aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:36.275464 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146979d-9323-4f22-9230-75026b44f427 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.275752 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146979d-9323-4f22-9230-75026b44f427 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.276029 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146979d-9323-4f22-9230-75026b44f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.303364 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-c146979d-9323-4f22-9230-75026b44f427 None None] MFA Rules not processed for user `5a9dca97ed4345f3992c41312d9031c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:36.304511 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-c146979d-9323-4f22-9230-75026b44f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:36.349724 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:36.371287 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1214/2407] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:36.382928 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:36.384605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:36.442338 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bee2a-cc27-481d-83cd-ead44f029974 admin admin] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:36.445936 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a994eec4a44b782d847b132c6eaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:36.446577 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:36.446853 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:36.447148 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:36.455314 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:36.456731 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:36.465342 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1194/2408] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:38.613069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e272b-5c17-4c26-a524-74b6ff9e9d3d None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:38.613548 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e272b-5c17-4c26-a524-74b6ff9e9d3d None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:38.613761 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e272b-5c17-4c26-a524-74b6ff9e9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:38.657061 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-0b7e272b-5c17-4c26-a524-74b6ff9e9d3d None None] MFA Rules not processed for user `99bd31cf5ff24090be9f73fa32514be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:38.658753 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-0b7e272b-5c17-4c26-a524-74b6ff9e9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:38.737810 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1215/2409] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:46:38.756185 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:38.761565 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:38.828513 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:38.836144 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783d0f7-298d-41da-8d03-d940981137c8 service glance] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:38.843493 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '356ba9813a5740a2b6495debb9c1e5bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:38.848078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:38.848078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:38.848078 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:38.858885 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:38.860497 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:38.869417 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1195/2410] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 15:46:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:46:45.822229 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286251-07d7-4c35-8040-b8c8b5f0dee9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:45.822809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286251-07d7-4c35-8040-b8c8b5f0dee9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:45.822809 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286251-07d7-4c35-8040-b8c8b5f0dee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:45.846677 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-b4286251-07d7-4c35-8040-b8c8b5f0dee9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:45.847894 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b4286251-07d7-4c35-8040-b8c8b5f0dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:45.926641 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1216/2411] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:45.951850 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:45.953222 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:46.040999 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b9f5-594e-48a6-8a1a-1659580e7ef0 service swift] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:46.047397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:46.048016 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:46.048301 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:46.048578 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:46.057422 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:46.059640 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:46.074367 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1196/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:50.295406 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] REQUEST_METHOD: `POST` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:50.295931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:50.295931 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:50.316726 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.auth.core [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] MFA Rules not processed for user `824d2e5db1534ae296c3e88c19fcec31`. Rule list: `[]` (Enabled: `True`). {{(pid=81790) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:50.317939 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:50.326069 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1217/2413] 10.222.0.25 () {58 vars in 1016 bytes} [Thu Sep 1 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:50.412451 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:50.424750 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0066bcf-3d31-4098-a9d4-401183bd8fb8 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:50.430605 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7d3b76b6b746f1b1c2585feef177b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:50.431210 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:50.431494 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:50.431772 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:50.440447 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:50.442051 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:50.452165 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1197/2414] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:47:00.310889 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=61 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:47:00.447411 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=45 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:47:32.329638 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] Authenticating user token {{(pid=81790) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:47:32.331046 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:47:32.398425 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86d77-1151-452b-a5d7-225fa4adeab9 None None] Validating token access rules against request {{(pid=81790) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:47:32.403415 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142c9bc9ea44b61919dbb527904ef55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81790) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:47:32.404015 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] REQUEST_METHOD: `GET` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:47:32.404294 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:47:32.404563 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81790) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:47:32.406297 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.fernet_utils [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81790) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:47:32.417243 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:47:32.418840 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b446b-9293-4b47-9464-3bc073fa87a0 service placement] RBAC: Authorization granted {{(pid=81790) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:47:32.428426 dv-cinder-852210-8-smb devstack@keystone.service[81790]: [pid: 81790|app: 0|req: 1218/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:47:42.424285 dv-cinder-852210-8-smb devstack@keystone.service[81790]: DEBUG dbcounter [-] [81790] Writing DB stats keystone:SELECT=32 {{(pid=81790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:49:34.966647 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] Authenticating user token {{(pid=81791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:49:34.968086 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:49:35.025845 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c92a06-f155-46de-9e33-422d8cc17a21 service nova] Validating token access rules against request {{(pid=81791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:49:35.029526 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908fc8044dc4428a53ef40cbcdff4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '456711e5223a45e8a54f00205edd003c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:49:35.030154 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] REQUEST_METHOD: `GET` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:49:35.030440 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:49:35.030722 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:49:35.032438 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.fernet_utils [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:49:35.041952 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:49:35.043397 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b2ea-25db-4dad-ba43-449ba3d73111 service neutron] RBAC: Authorization granted {{(pid=81791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:49:35.051267 dv-cinder-852210-8-smb devstack@keystone.service[81791]: [pid: 81791|app: 0|req: 1198/2416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 15:49:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:49:45.047849 dv-cinder-852210-8-smb devstack@keystone.service[81791]: DEBUG dbcounter [-] [81791] Writing DB stats keystone:SELECT=26 {{(pid=81791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}